Yes, this is recommended to prevent contamination of the potato salad. If you plan to serve the potato salad at room temperature you can let it stand on the counter for an hour or so before serving. If you choose to do this, I would be inclined to discard any leftovers rather than putting them back into the refrigerator. Potato salad should always be kept chilled. It will be fine if you serve it chilled from the refrigerator and then return the dish immediately to the refrigerator for another meal.