 In 1856, Robert married another slave, a hotel maid named Hannah Jones. The couple was trusted enough to live apart from their owners, although the owners still took most of their pay. They had a daughter and then a son who died at the age of two.