Soaking potatoes in water helps remove excess starch. Excess starch can inhibit the potatoes from cooking evenly and can create a gummy or sticky texture on the outside of the potatoes.