A short way off was a venerable stone building, now called the Palace House, once the residence of the abbot, who being too great a man to live with the monks, had a house to himself.  When convents were abolished, this was turned into a residence by the Duke of Montague, to whose family it had been granted.  He enlarged and beautified it, enclosing it in a quadrangle with walls, having a low circular tower at each angle, encompassed by a dry moat crossed by a bridge.  The whole building is now fitted up as a modern residence.