Skiing is a sport involving the use of skis to glide on snow. Downhill skiing is a type of skiiing that involves skiiers going downhill on skills. If someone is saying their skills are really going downhill, means that their skill set is getting worse. This joke is playing on the word "downhill" and how it applies to skiing, and skills. 
My skiing skills are really going downhill .