Yes, you do. So-called “hard water” has a higher concentration of minerals than soft or gentle water. This means that deposits will build up faster on the surfaces in your tankless water heater, which, in turn, will require more frequent descaling.