If you accidentally oversteep the tea and it becomes bitter, unfortunately, there's no quick fix. You'll need to discard the oversteeped tea and start anew with fresh tea bags to avoid the bitterness. Oversteeping releases excessive tannins into the tea, causing the bitterness. While adding more water could dilute the bitterness, it may also compromise the flavors of the tea.