With his wife, he had nine sons and four daughters including, Edward Somerset, 2nd Marquess of Worcester, his heir and successor, and Thomas Somerset, his second son, who became a Catholic priest in Rome before joining the Oratory of St Philip Neri in Perugia before Pope Clement IX sent him to England as his internuncio.