He and his brothers, Joseph and Angler, began their careers as housewrights and carpenters while in their teens but, early on, Samuel's work caught the eye of Salem's pre-eminent merchant, Elias Hasket Derby.