It’s perfectly ok to keep coffee with milk inside of a Thermos. Just ensure that the beverage stays above 140ºF (60ºC). Once the beverage drops below this temperature, bacteria can start to grow to harmful levels. So ideally, you need to drink within 2 hours.