The country house , of which parts remain , dates from 1833 -- 42 was designed by Charles Barry .
Charles Barry was working on the rebuild of the Palace of Westminster .
The country house , of which parts remain , dates from 1833 -- 42 was designed by Charles Barry , while he was working on the rebuild of the Palace of Westminster .