A native of Oak Park, Illinois, United States, Kurtz graduated from Knox College in 1950, and was awarded a Ph.D. degree from Princeton University in 1956, where his advisor was John Tukey, and joined the Mathematics Department of Dartmouth College that same year, where he taught statistics and numerical analysis.