Alexandria Bay is a village in Jefferson County, New York, United States, within the town of Alexandria. It is in the Thousand Islands region of northern New York. The population of the village was 1,078 at the 2010 United States Census.