Bottle brushes are made to clean inside small or narrow bottles that a sponge can’t fit into. Soak the bottle in soapy water first and then circle the brush inside the bottle a few times. Most bottle brushes come with a nipple brush to get into the smaller areas like the nipple of the baby bottle.