Sharp was born in Falmouth, Kentucky. He completed his PhD in chemistry at the University of Illinois at Urbana-Champaign in 1969. After completing his PhD he worked at the California Institute of Technology until 1971, where he studied plasmids and, later, gene expression in human cells at the Cold Spring Harbor Laboratory under James Watson.