First, rinse and clean the cooler with a mixture of vinegar and hot water. Then, scrub the inside with some baking soda and water to help remove the vinegar flavor and further break down the stains. Finally, rinse your water cooler with clean water before filling it up again.