Vinegar is a safe and effective way to remove rust stains from clothes, but it may cause some fabrics to discolor or fade. Test a small area first and dilute the vinegar with water if needed.