Pastore was born in The Bronx, New York City, New York on July 14, 1946. Pastore was educated at Pace University. Pastore was married to Nancy Berke until they divorced, they had one child. Pastore currently lives in City Island, New York.