For cave paintings, all accessible by guided tour only, the most attractive site is the Grotte de Font-de-Gaume, reached by an easy walk up on a cliff above the eastern edge of town.
The Grotte de Font-de-Gaume is the best place to look at cave paintings.