Hill was born in New Orleans, Louisiana. While still a teenager, he played drums in local bands. In 1951, while still drumming, he started his own group, the House Rockers. At first, Professor Longhair played piano, then later it was Huey "Piano" Smith. Hill got different musicians for the House Rockers in 1958, and started singing.