Even though you can use milk to make hot chocolate in your coffee maker, it’s really not advisable. The milk could quickly sour upon cooling, and both gum up your coffee maker and make a nasty drink. It can also make it difficult to clean your coffee maker afterward.