Soak the rusty part in vinegar until completely soaked through. 2. Let the vinegar work on the rust for 24 hours. 3. Remove the rust with a wire brush or aluminium foil.