Rumbling sounds typically indicate a buildup of sediment at the bottom of the water heater. Because of this, the water heater is not working as efficiently as it should, and you’ll likely see an increase in water bills if not fixed promptly.