Rumbling noises will happen naturally as sediment builds up at the bottom of the tank, but the sediment shouldn't be allowed to build up continually. Schedule a maintenance appointment to have your water heater tank flushed.