Madison never had children, but he adopted Dolley's one surviving son, John Payne Todd (known as Payne), after the marriage.
Madison nu avea copii, dar a adoptat un fiu supraviețuitor al lui Todd, John Payne Todd (cunoscut sub numele de Payne), după căsătorie.