Anything with a voltage difference of 5 V can power an Arduino as long as it has enough capacity to maintain that voltage to do anything useful with it. And that also goes with potato batteries. But whether you can hook up enough potatoes to run an Arduino might be difficult on its own.