Born in Dennistoun, Glasgow, Sharp trained to become a plumber while moving through the grades as a footballer, being signed by top division Partick Thistle as a teenager in 1939 after a short spell in Junior level with Shettleston.