Construction of the Scarborough station dates back to the 1860s, when the first station building stood along the Hudson River Railroad, which was completed in 1851 and served areas from New York City to Rensselaer.