Rest can mean a break from something, but it can also mean a part of something. "The rest" of something is the last part of something. "Never did get the rest" can mean "I never did get a break" or "I never did get the last part of something". This joke is playing on the word "rest" and its different meanings.
The phone call interrupted my nap , and I never did get the rest .