To "go downhill" can be understood in the literal sense of someone moving downhill. It can also be understood as something decreasing in quality. There is a type of skiing called downhill skiing. The joke is saying that skiiers do not die, they just decrease in quality, or "go downhill". 
OLD SKIERS never die , but they go downhill fast .