Caves are formed when minerals in their composition react to various natural acids to form the compounds that are dissolvable in water. Therefore, if the rock doesn't have the minerals that will react chemically, then chances are very good that a cave will not form.
