You can, though for the most flavor extraction it's best to use a smaller amount of boiling water for steeping and then add cold water after it's steeped.