Suppose you manage to collect all 160 altars. In that case, you'll complete the Altar of Lilith Collector challenge and earn the Treasure and Hoarder titles. That alone, plus the bonus stat points, should make you ready to find every last altar.