Klein was born to a Jewish family in The Bronx, New York. He studied fashion in New York City and apprenticed for a suit manufacturer. In 1968, he launched his first company with a childhood friend, Barry K. Schwartz.