 In 1856, Robert married another slave, a hotel maid named Hannah Jones. The couple was trusted enough to live apart from their owners, although the owners still took most of their pay. They had a daughter, and then a son, who died at the age of two.