A tea bag caddy is simply a container that you can store tea bags in. Tea bag caddies can be portable boxes, a dispenser, a container that sits on your countertop, and more.