Her mother Emily (née Milliken) had become a "permanent mental invalid" after the death of her infant son, and Hale was brought up by her aunt Edith Perkins and her uncle Unitarian Minister Reverend John Carroll Perkins.