Though it is perfectly safe to feed a baby cold milk if they will take it, most babies prefer warm milk. Consider that breastmilk is body temperature, so most babies will be most comforted by milk that is warmed to at least this temperature since that is as nature intended.