Crosby attended churches of various denominations until spring 1887, including the Plymouth Church of the Pilgrims in Brooklyn Heights led by Congregationalist abolitionist Henry Ward Beecher who was an innovator with church music.