Like vinegar, baking soda is another cleaning alternative that is typically safe to use on stainless steel. You can use a paste made of baking soda and water to gently clean stainless steel surfaces. Apply the paste in the direction of the steel grain, then wipe away with a dry cloth.