 Both armies, exhausted, held their positions until the night of July 4th, Independence Day. Then Lee withdrew. The Union army was too weak to pursue the fleeing Confederates, who retreated to Virginia, never again to invade the North. Gettysburg was the turning point of the Civil War. Each side suffered 25,000 casualties in less than 72 hours.