The joke is that the subject is trying to join the rambling club but the person he's talking to in order to join is rambling, or talking on and on, which ironically prevents the subject from joining the club.
I wanted to join my local rambling club , but the guy I spoke to on the phone just went on and on .