There are 94 buildings in Midhurst listed with Historic England as having special architectural or historic interest, while the earthworks and ruins of St. Ann's Castle have been designated as a Scheduled Monument.