The hall itself, built in the 1860s by the third Earl to the designs of Anthony Salvin was the 3rd building on the site replacing a smaller Georgian house which in turn had replaced a large Baroque house designed by Talman which had burned down.