To deep clean a water filter, mix equal parts vinegar and warm water, then dip the filter housing in the solution. Use a sponge to scrub the debris out of the housing. If you choose to use bleach or another harsh cleaner, make sure it's properly diluted to prevent it from damaging the housings or contaminating your water once you reinstall the cartridge.