Williams was born in Chicago, Illinois on July 21, 1951. His father Robert Fitzgerald Williams (September 10, 1906 – October 18, 1987) worked for Ford Motor Company. His mother Laura McLaurin (née Smith, September 24, 1922 – September 4, 2001) was a former model from New Orleans, Louisiana. His great-great-grandfather on his mother's side was Mississippi senator and governor Anselm J. McLaurin. Williams' ancestors were English, Welsh, Irish, Scottish, German, and French.