While dunking your tea bag a few times, you're creating movement of water inside your cup. This flow makes it easier for molecules to move away from your bag. If you wouldn't move the bag, all those molecules need to move using diffusion only which does take longer to spread throughout the cup.