You can, but it won't taste as good. (Water works with store-bought hot cocoa mix, but not so well with homemade hot cocoa.)