There isn’t a hard and fast rule about when you should stop using a bottle warmer or heating up your baby’s milk. This is entirely up to you! The transition is usually easiest when you decide to start having your baby drink from a cup full-time.