Dolgoff was born in the shtetl of Ostrovno in Vitebsk Governorate, Russian Empire (in present-day Beshankovichy Raion, Belarus), moving as a child to New York City in 1905 or 1906, where he lived in the Bronx and in Manhattan's Lower East Side where he died.