You should consider replacing your tank water heater if it's over 10 years old (use the serial number to find out the age). Replace it if it requires frequent repairs or doesn't give you enough hot water anymore. Rusty water is another sign that it's time to replace the water heater.