Portage is a city in Columbia County, Wisconsin, United States. It is the county seat Columbia County. As of the 2010 census, 10,662 people lived in Portage.. It is the largest city in Columbia County. The city is part of the Madison Metropolitan Statistical Area.