From 1983 until her death in 1996, he was married to Linda Rogoff, a one-time manager of The Pointer Sisters, whom he met at Carnegie Hall when he played the banjo with his band, the Beverly Hills Unlisted Jazz Band.