Columbia is an unincorporated community and census-designated place (CDP) in Knowlton Township in Warren County, New Jersey, United States. As of the 2010 Census, the CDP's population was 229. The area is served as United States Postal Service ZIP Code 07832.