To prevent becoming over-encumbered, I'd only prioritize carrying a second set if it has a specific use case, such as the mushroom set, which is light enough to not weigh down your inventory. Otherwise, just stick to one armor set at a time.