Yes, we would definitely recommend letting it all chill together because it allows the water to really infuse.