He was the great-grandson of Walter Dickinson who emigrated from England to Virginia in 1654 and, having joined the Society of Friends, came with several co-religionists to Talbot County on the Eastern Shore of the Chesapeake Bay in 1659.