For severe rust, you might need sandpaper. Choose the right grit and use it carefully to avoid harming the stainless steel while removing the rust.