Rumbling noises from a water heater are a clear indication of some serious issue with the unit. Generally, the reason behind it is the building up of sediment on the bottom of the water heater. However, if you face a similar problem, it is advisable to contact expert technicians at the earliest.