To clean your baby feeding bottle, start by washing it with water and soap. To sterilize it with boiling water, fill a large, clean pot with enough water to cover the bottles and submerge the freshly washed bottles in the water.