Cave was inspired to write "Where the Wild Roses Grow" after listening to the traditional song, "Down in the Willow Garden", a tale of a man courting a woman and killing her while they are out together.
Cave blev inspireret til at skrive "Where the Wild Roses Grow" efter at have hørt den traditionelle sang, "The Willow Garden", en fortælling om en mand som kurtiserer en kvinde og dræber hende da de er ude sammen.