Caves of Southwest USA. Caves are not one of the renowned features of the American West, partly since the limestone most conducive to their formation is not widespread, but others are found in a variety of rock types including sandstone, granite and lava.