Definitely. Contaminated water coming out of a dirty dispenser will never taste good. If you want to freshen up the taste of your water, give the cooler a deep clean.