Joseph had two American daughters born at Point Breeze, his estate in Bordentown, New Jersey, by his mistress, Annette Savage ("Madame de la Folie"): Pauline Anne; died young.
De asemenea, Joseph a avut două fiice americane născute la Point Breeze, moșia sa din Bordentown, New Jersey, de amanta lui, Annette Savage ("Madame de la Folie"): Pauline Anne; a murit de tânără.