Wear comfortable foot gear appropriate for caving. Boots or sturdy shoes with lug type soles work well. Wear gloves and warm clothes. Bring enough food and water for an unexpected stay in the cave. Do not litter and use a container for packing out all human waste.
Many caves require ropes, ladders and advanced climbing techniques.
Get training from experienced cavers before using any of this equipment. Caves are a very delicate environment that can be easily damaged. It takes many years of training to learn how to move through a cave, be patient.