He was the eldest child of Louis Jean de Saint-Just de Richebourg (1716–1777), a retired French cavalry officer (and knight of the Order of Saint Louis), and Marie-Anne Robinot (1736–1811), the daughter of a notary.