Removing a set-in rust stain can be difficult, but not impossible. First, try using a commercial rust stain remover or a homemade solution such as lemon juice or vinegar. If the stain persists, take the item to a professional cleaner or consider replacing it.