 In December of 1863, he was back aboard USS Planter when the steamer got caught in a crossfire between Union and Confederate troops near Folly Island. The captain of the boat, James Nickerson, panicked and ordered the boat to surrender. Smalls refused, knowing that he and the other black sailors would face execution if they were captured.