I do not recommend swapping the potato for pumpkin because pumpkin puree is far wetter than sweet potato puree is and as a result, the fudge may not be set up correctly.