Mowbray's son, John, inherited the building, and it remained in the Mowbray family until 1481, when it passed to William de Berkeley, 1st Marquess of Berkeley.
Mowbrays søn, John, arvede bygningen, og den forblev i familien frem til 1481, hvorefter den overgik til William de Berkeley, 1.