Milk, definitely. If you have a choice definitely choose milk. Hot cocoa made with milk will be creamier, will taste chocolatier and will be tastier than hot cocoa made with water.