Yes, and you may not need special products to do it. Soaking your knife in vinegar or a mixture of lemon juice and water can loosen the rust enough to be scrubbed off.