Bud Hillis was a younger brother to renowned choral director Margaret Hillis. Their father, Glen R. Hillis, was the Republican nominee for Governor of Indiana in 1940, losing by less than 4,000 votes. His maternal grandfather and namesake, Elwood Haynes, was an inventor and automobile pioneer.