While you can use water, using milk (or a milk substitute) is generally preferred as it gives hot cocoa a creamier and more indulgent texture and flavor.