Freeze Tea in Ice Cube Trays for Better, Less Watery Iced Tea. Iced tea is wonderfully refreshing, especially on hot days. If you want to make even more flavorful tea that’s not watered down, make some iced tea cubes—literally, iced tea. All you have to do is brew tea as usual and freeze it in ice cube trays.