As this cools the potatoes will continue to soak up the dressing. It's just what potatoes do, they like to soak up whatever they are mixed with. So, if you notice your salad is just a little dry when you are ready to serve, add a little more milk or chicken stock and some mayonnaise and it will restore the creaminess of your potato salad.