Simon was married to Jeanne Hurley from 1960 until her death in 2000. Then he was married to Patricia Derge from 2001 until his death in 2003. He had two children with Jeanne. One of them was Lieutenant Governor of Illinois Sheila Simon.