Born in Thurles, a small town in Munster, Ireland, Julia was the only child of Morgan Kavanagh (died 1874), author of various philological works and some poems, and Bridget Kavanagh (née Fitzpatrick).