Yes, it is definitely worth going to the trouble of unlocking all the Altars of Lilith in Diablo 4. They offer significant enhancements to your character’s abilities and performance, as well as Renown for leveling up your regions.