For this classic potato salad recipe, yes. You want the dressing and flavors to soak into the potatoes and give them a great taste. Don't forget to season at the end with extra pickle juice, salt, pepper, and herbs!