Potatoes should be cooled to at least room temperature, but chilling the potatoes in the refrigerator before adding them to the mayonnaise mixture is even better unless you are making a hot potato salad.