You should 100% use milk over water when making hot chocolate for a thicker and creamier taste. Whole milk will give a creamier and sweeter taste than other kinds of milk, but you can use different types according to your preference.