Yes, many babies can tolerate milk straight from the fridge, but many babies do not enjoy this. Warm it gently if you can, but avoid shortcuts, like microwaving, that can scorch your baby’s mouth.