DioGuardi's idea for the vocals on "Little Voice" were "very, very character—it was one of those songs that's more about the character of the vocal as opposed to being a more straight-to-the-middle kind of vocal performance".