You can absolutely swap ground turmeric for fresh turmeric. You can also skip it altogether. If you opt to use ground turmeric, add it to the pot when you add the potatoes, it only needs to cook for a minute.