Combat is not always necessary for fragment farming. All around the unnamed city are tiny black chests that will give you a fragment of power when you interact with them. If you're on Siptah, the summoning pools allow you to summon easier enemies to fight that will drop fragments of power among other useful treasures.