Graveney was married to Jackie Graveney from 1952 until her death of Alzheimer's disease in 2013. Graveney's brother, Ken, died on 25 October 2015. A week after his brother's death, Graveney died on 3 November 2015 from Parkinson's disease at the age of 88.