Brushing off dirt and cleaning the fence with a jet of water is the first step in cleaning rust from chain link fences. After that, use a wire brush to remove any leftover rust and spray or brush on a rust inhibitor.