Lee began his career as a musician at the age of 14 with the Sydney band Noise Addict, later releasing 11 solo studio albums and collaborating with artists such as Daniel Johnston, Zooey Deschanel, Sean Lennon and more.