You want to give the potatoes a chance to sizzle and crisp up before you flip the potatoes. Just keep an eye on them to ensure your heat isn't too high and avoid burning potatoes. Otherwise, it isn't necessary to stir the potatoes, just flip them halfway through cooking.