Butterfly pea tea is commonly mistaken for a fruity drink, and it isn't uncommon for the drink to stain your teeth. Pregnant women should also avoid drinking butterfly pea tea, as large amounts of caffeine can cause congenital disabilities if consumed during the first trimester.