When Texas seceded from the Union in 1861, Smith, promoted to major on January 31, 1861, refused to surrender his command at Camp Colorado in what is now Coleman, Texas, to the Texas State forces under Col. Benjamin McCulloch; he expressed his willingness to fight to hold it.