In fact, if your child has taken some of a bottle but does not want the remainder, you should dispose of it within an hour. Don't store it in the fridge to use later. Milk-based products are renowned for bacterial growth. Bacteria is introduced when your infant drinks from a bottle, and the formula should not be stored. If it is kept in the refrigerator, heat it up before feeding your baby.