To decide if a baby's plastic or glass bottle needs to be replaced, inspect it carefully. A good guideline is to replace them every four to six months if there are no visible cracks or chips. Discard them if the plastic bottles, BPA-free or not, start to show signs of discolouration.