Yes, the cave is a short walk from the base of the staircase many signs show its location. It's free to enter, but donations for maintenance are appreciated.