Elliot was married to Betty Dole from 1948 until her death in 1974. He lastly married Connie Elliot from 1977 until his death in 2012. Elliot died on August 15, 2012, in his Studio City, California home from natural causes, he was 89 years old.