Indicators you need to replace your water heater include rust-colored water, loud noises, leaks or seeping water, a small supply of hot water and, finally, if the water heater is more than 10-12 years old.