Yes, you can. Strain the tea and bring it to room temperature. Fill a glass with ice and pour the tea over the ice. Serve chilled.