Clokey was born Arthur Charles Farrington in Detroit, Michigan. When he was nine years old, his parents divorced. He stayed with his father, Charles Farrington. After his father died in a car accident, he went to live with his mother in California. However, his stepfather refused to raise another man's son, and so Arthur was sent to an orphanage. When he was 11 or 12, he was adopted by Joseph W. Clokey. Clokey was a classical music composer and organist who taught music in Claremont, California. He taught Arthur painting, drawing, and filmmaking.