He later served as Secretary of State for War and the Colonies from 1801 to 1804 when it was said he had "a better grasp of the local or colonial conditions, and a more active spirit than did some of his successors."