By the time of the 6th Baron Stafford (d.1640) the family had sunken into poverty and obscurity, and in 1639 he suffered the indignity of being requested by King Charles I to surrender his title on account of his "having no parte of the inheritance of the said Lord Stafford not any other landes or means whatsoever".