You can if you want to, but I don't think it's necessary. The Witch Queen and her Guardians aren't that strong in terms of how much health and armor they have, so doing damage won't necessarily be an issue. The bigger issue in this fight is avoiding incoming attacks and environmental hazards. The Witch Queen's fight is fairly easy, and in my honest opinion, you don't need to bring any stat-boosting potion.