Remove any loose rust with a garden hose by spraying the area with a high pressure nozzle. Then, scrub the area with an abrasive material, like steel wool, a wire brush or sandpaper. If the rust is stubborn, use white vinegar or naval jelly to chemically treat the fence.