Generally, tankless water heaters should be flushed once a year to maintain efficiency. However, depending on the hardness of your water, you may find it beneficial to flush out your tankless water heater two or three times a year.