He was born in Cyrrhus, and was the son of Gaius Avidius Heliodorus, who served as "Praefectus augustalis" (prefect of Roman Egypt), and Julia Cassia Alexandra, who was related to a number of royal figures, including her descent from both Augustus and Herod the Great.