In Illinois Caverns are rooms where every reachable formation has been sawed off. Uneducated recreational caving can be damaging. Foot traffic compacts substrate, reducing habitat. Trash gets deposited. Oils get left on formations when people touch them, preventing deposition and damaging the formation.
Careless movement breaks formations.
Unseen creatures are trampled. For years, spent carbide was simply left on ledges or washed out into cave streams, poisoning them incrementally. Bat hibernacula have been disturbed all over breeding ranges. At the worst, caves have been subject to purposeful vandalism - spray painting, partying, etc. Solutions Change can only be brought about through education, and elevation of natural areas above monetary gain.