Charpentier was born in Dieuze, Moselle, the son of a baker, and with the assistance of a rich benefactor he studied violin at the conservatoire in Lille before entering the Paris Conservatoire in 1881.