There can be many reasons as to why the potatoes fall apart. They might be overcooked, not cooled off, or you might toss them in the pan too often or too early. But don’t worry about a few slices breaking apart. I actually like the combination of smaller and larger pieces. That’s very normal. You just don’t want all of them to fall apart and turn into mush.