Yes, after boiling the potatoes should be cool enough to handle in order to safely peel and chop them. And, because this salad’s sauce contains mayonnaise, you want to cool the potatoes so they don’t heat up the mayo and make it runny or oily.