Gilt sounds like the word guilt but the two words mean different things. Gilt means to cover something thinly with gold. People who like gold paint have a gilt complex. This joke is a play on "guilt complex". A guilt complex is when someone has the obsession that they have done something wrong. In this case, someone has a gold covering complex.
People who like gold paint have a gilt complex .