The Hill family had come to Virginia two centuries before the Civil War. The earliest family members (then spelled "Hull") traced back to 12th century England. Henry and William Hill of Shropshire came to Virginia in 1630. They settled in Middlesex County, Virginia. Both brothers were tobacco farmers and both had large families. In 1740, Russel Hill, William's great-grandson, moved to Culpepper County, Virginia. His son, Henry Hill served in the American Revolutionary War under Colonel Henry "Light Horse Harry" Lee. His son, Thomas Hill, was a farmer, merchant, and politician. He married Fannie Russel Baptist. Together they had four sons followed by three daughters. Their fourth son was Ambrose Powell Hill, Jr.