Perelman was born in Brooklyn, New York, the only son of Joseph and Sophie Perelman, who moved from one failed business to another until they found themselves raising chickens on a farm and running a dry-goods store in Providence, Rhode Island.