Parfit was born in Chengdu, China. His parents, Jessie and Norman Parfit, were British medical doctors who moved to Western China. After a year in China, Parfit moved to Oxford, England where he was raised. He studied at the University of Oxford.