Astor became engaged to Eileen Sherman Gillespie (1915–2008), the elder daughter of Lieutenant Lawrence Lewis Gillespie (1876–1940) and Irene Muriel Augusta Sherman (1887–1972), in early December 1933.