He enjoyed an uneasy relationship with the citizens of Wells, partly because of his imposition of taxes. He surrounded his palace with crenellated walls and a moat and drawbridge. The Palace was now a castle.