Anderson was born in Covington, Georgia, and attended Emory University before departing to serve as a second lieutenant of Georgia cavalry during the Mexican–American War.
Anderson blev født i Covington i Georgia, og gik på Emory University inden han besluttede at blive løjtnant i Georgias kavaleri under den Mexicansk-amerikanske krig.