Yes, you can. It is a great alternative to milk. You may want to try my spiked eggnog recipe.