The French were the first European settlers in the area and they founded a settlement in 1720 named Port La Joye. British forces built Fort Amherst near the site of the abandoned Port La Joye settlement after they took control of the settlement and the rest of the island during the height of the French and Indian War. The town is named after Charlotte of Mecklenburg-Strelitz, queen consort of the United Kingdom.