Mansfield was the only child of Herbert William Palmer (1904–1936) and Vera Jeffrey Palmer (1903–2000). She was born in Bryn Mawr, Pennsylvania. Her father was of German descent and her mother was of English descent.