Like most other things, it depends on the type and model you’re using. An electric heater might not make any noise at all, especially the more expensive ones. On the other hand, both a solar and a gas pool heater can make some noise depending on the model. Still, this varies from product to product and you should check for each one if this is a concern.