They've struggled to recover from the scandal of Boris Johnson's Downing Street Covid parties and the turmoil of the Brexit referendum, which split the country and the party and led to five prime ministers in just six years.