Yes, you can use a tea bag instead of loose tea leaves. Just make sure to steep the tea bag in boiling water for 3-5 minutes before adding your spices and milk.