 becomes a political liability, that's when they want to get rid of him. Not when he invited any number of world conflicts all over the place, not when he caused any number of problems, not when any of them knew from their private meetings that he was causing great harm to the country in some of the conduct of the office.