It was probably Edward Seymour, 1st Earl of Hertford (1539–1621), son and heir of the 1st Duke, of nearby Wulfhall, who in about 1575 built the first house, known as Totnam Lodge, and enclosed its surrounding land to form a deer park.