His father was Joseph Antoine de Villeré, an official in the French Navy during the reign of King Louis XV and later a colonial militia captain in the German Coast area of present-day southeast Louisiana.