Smith first dated Jimmy Carter in 1945 while he was attending the United States Naval Academy at Annapolis. Smith agreed to marry Jimmy in February 1946 when she went to Annapolis with his parents. On July 7, 1946, they married in Plains. The couple had four children named Jack, James Earl III, Jeff, and Amy Carter.