He served until the beginning of the U.S. Civil War when he found himself "at variance with the Democratic Party, by which he had been so long honored, and yet unwilling to desert it for the Republicans, with which he was more in sympathy, he turned more closely than ever to his business, and never again held office."