Yes. This helps your drip coffee maker to stay as efficient as possible and will prevent your coffee from tasting strange. Some coffee makers have compatibility with various water filters so you can fill up straight from the tap as opposed to a purified water source. Most tanks are removable, which is useful for cleaning too.