In 2003, Thile and mandolinist Mike Marshall made a duet album called "Into the Cauldron," which had covers by artists from Charlie Parker to Bach. The next year, Thile released "Deceiver", a pop album on which he played and wrote every song himself. He mainly played his mandolin on the album, but also played electric guitar, piano, drums, violin, viola, cello, and bass.