Haller was born in Altdorf, Switzerland. He studied as an apprentice at hotels and ski resorts in Bern, Davos and Lucerne. He married Carole Itjem in the 1950s. They had four children. Haller died on November 7, 2020 in Rockville, Maryland at the age of 97.