Robinson was born on February 18, 1912 in a low-income neighborhood of Georgetown, which, due to the presence of Georgetown University, Holy Trinity church, and the Convent of the Visitation, was known as Holy Hill.