This 6000 sq ft home began in 1882 as a simple four-room structure in the bend of the Bon Secour River. In 1898, Charles & Susan Swift bought the house and brought their growing family here to begin a sawmill and lumber business that continues in south Alabama to this day. They built a sawmill on the river east of the house, and although it burned in 1913, their business continued to expand. Eleven of their children grew to adulthood here, and the house was enlarged in 1902 and in 1908.

In 1976, the home was purchased by Nicholas Coles. An entrepreneur and antiques collector, he made this his home until his death in 2007. Today the home is filled with Mr. Coles beautiful antiques.