Yes, it is important to rinse the tool with water to remove any residue from the vinegar and baking soda solution. If left on the surface, the residue can cause further rust and damage to the metal.