No, using frozen potatoes will be just fine. It may just need a bit more cooking time.