The 1776 barony became extinct on his death in 1797, while he was succeeded in the 1778 barony as second Baron according to the special remainder by his nephew, William Amherst, who later was elevated to an earldom in 1826.