Yes, dungeons in Last Epoch have unique rewards, challenging gameplay and valuable items so it's worth doing for progression and loot.