Rust can enter tap water when corroded pipes or fittings break down, releasing rust particles into the water supply.