Gardner went to Repton School to teach music, but after two terms World War II started and he joined the RAF. He conducted the RAF band and played the piano for the dance band. He enjoyed playing jazz and started a swing band. Later in the war he was a navigator in the fighting.