He was married three times: his first wife was the musical comedy star Zoe Gail (married 1943, divorced 1950), with whom he had a daughter, actress-writer Stacey Gregg; his second wife was the actress and singer Pat Kirkwood (married 1956, divorced 1979), with whom he starred in the 1958 musical comedy "Chrysanthemum"; and finally, in 1980, he married Carmel Lytton, with whom he had a son and a daughter.