Tankless water heaters are normally not very noisy.
Of course, it depends somewhat on the model you have; some are louder than others. Most homeowners with tankless systems report that they can’t hear their units at all when they’re located in the garage or basement.
Most likely, the device that’s drawing hot water (a dishwasher, shower, or faucet) is going to make more noise than the water heater.