The favour shown him by Marlborough did not deter Rivers from paying court to the Tories when it became evident that the Whig ascendancy was waning, and his appointment as constable of the Tower in 1710 on the recommendation of Harley and without Marlborough's knowledge was the first unmistakable intimation to the Whigs of their impending fall.