Arkin was married to Jeremy Yaffe from 1955 until they divorced in 1961. He married Barbara Dana in 1964. They divorced during the 1990s. He married Suzanne Newlander in 1996. He has two sons with Yaffe including actor Adam Arkin, and 1 with Dana. He lived in Carlsbad, California from 2007.