As documented in the authorised biography "No Certainty Attached" (written with Kilbey's involvement), Kilbey was dependent on the drug heroin during the 1990s, an aspect of the musician's personal life that was mostly hidden until Kilbey was arrested on a drug-related charge in 1999 in New York City.