	Rolph was born in San Francisco, the son of Margaret (Nicol) and James Rolph. He had four brothers and two sisters. After attending school in the Mission District, he went to work as an office boy in a commission house. He married Annie Marshall Reid (1872–1956) and had at least one son: James Rolph, III (1904-1980).