Typically people go to the gym and increase their fitness to lose weight, or excess fat. If an opinion "carries weight" it means that opinion has meaning and can affect someone strongly in an emotional way. The joke is centered on the word "weight" and its different uses. 
I found out that at the gym , their opinion on fitness carries a lot of weight .