He decided to leave his seat at Devonport, partly owing to the baths scandal, returning instead for his native Northumberland North in an 1847 by-election, from the family seat at Fallodon, which he had recently inherited from his uncle, Henry Grey.