Yes, you can put tea bags in cold water to make cold brew. If you opt for this route, which we dub “the easy method,” just allow yourself enough time for the bags to steep in order to get a robust, strong brew—we recommend steeping for 10-12 hours.