John Seymour, 4th Duke of Somerset (1629–1675), uncle, inherited the estate in 1671 on the death of his nephew the 3rd Duke, and in 1672 he rebuilt Totnam Lodge and redesigned the deer park, which at that date included long tree-lined walks and a deer "chase".