Depending on the model of tankless water heater you buy, the size of your current storage tank, and whether it runs on gas or electricity, you could save anywhere from 5% to 69% on your water heating bill or gas bill.