Yes, it is best to let the potatoes cool before adding them to the other ingredients. This will help all of the flavors combine together better.