Yes , you can make hot cocoa with either water or milk. Using milk will result in a creamier and richer beverage, while water will provide a lighter and less creamy taste. Choose whichever option suits your preference.