Formed as an alternative rock group in 1997 in East Fremantle, Eskimo Joe was initially a side project of Freud's Pillow, with MacLeod on guitar, Quartermain on drums and guitar, and Temperley on bass guitar and vocals.