When left to float in any liquid, citrus fruits will start to impart a bitter taste after many hours. If you have leftover sangria, or made a pitcher to have on hand (smart!), either take out the orange slices before you store it in the refrigerator or use the orange slices in your serving glasses and keep them out of the pitcher altogether.