A good way to remove rust without using any chemicals is to use sandpaper or any other gritty surface to buff the rust away. You can also try using steel wool for hard to remove rust from your bench vise.