 Robert was born into slavery in 1839 to a mother who served the white masters of a house in seaside Beaufort, South Carolina. He grew up with more autonomy than many of his peers and had a streak of independence that sometimes got him into trouble. As a young teen, Robert Smalls was caught in the streets after the curfew at nightfall for black people and arrested.