The best way to clean concrete stains depends on the stain. For instance, vinegar is useful for removing rust stains. Simply pour diluted vinegar on the stain and allow it to soak in for 15 to 20 minutes before scrubbing with a stiff brush. Rinse the area afterward.