The caves are formed in limestone at the southern extremity of the Sydney basin, a broad expanse of New South Wales between this point, the city of Newcastle in the north, the town of Lithgow to the west and the Pacific Ocean to the east.