 To add insult to injury is an expression that comes from the literary world. It dates way back to 25 BC and was from a writer from ancient Rome and it was from the story of the bald man and the fly. In that story a fly stings a bald man on the top of his head and the man swats at the fly trying to kill it but the fly moves away so that the man hits himself on the head as well.