In the 17th and 18th century the castle was occupied by the Mahony family, while the Courtenay Earls of Devon lived in Courtenay Castle; much of what had survived of the Desmond Castle was demolished in the 18th century to make room for Courtenay Castle.