Allow the potatoes at least 30 minutes to cool down before adding any mayonnaise type dressing, this will prevent the mayonnaise from becoming oily.