Smith attended Harvard College (now Harvard University) from 1825 to 1829, and was a classmate of Oliver Wendell Holmes, Sr. .He graduated in 1829 and subsequently attended Andover Theological Academy.