Rust on the outside of your hot water tank is frequently the result of an old water heater. It does not necessarily imply that the inside lining of your water heater is faulty, but you should have it checked. If your water heater is more than 15 years old, replacing it can be a preventative measure that will save you from a very messy (or wet) situation.