Yes, Sweet Tea can eventually develop a sour taste. Adding baking soda helps extend its freshness, but it will still eventually "go off." It's best to consume Sweet Tea within 48 hours of making it. Always store it in the refrigerator.