Soaking potatoes in water aids in the removal of extra starch. Excess starch can prevent potatoes from cooking evenly and leave them with a gummy or sticky feel on the outside. Cold water is utilized because hot water would activate the starch, making it more difficult to remove from the potatoes.