Horowitz began making recordings in 1928. He recorded for several record labels. His most famous early records were Rachmaninoff's Piano Concerto No. 3 with Albert Coates and the London Symphony Orchestra (the first time that piece was recorded) and Franz Liszt's Sonata in B minor. 