Your perfect baked potato might not be so perfect if it's falling apart. There are a couple of reasons why that might be happening, so here are two things to keep in mind before getting started. Type of potato. Using the right type of potato matters. it is recommended to use a medium or large meaty potato. Don't use anything super small or thin. Taking out too much potato. When you scoop out the inside of the potato to make the mixture, you want to make sure you don't take out too much and make your shell too thin. I like to leave a thin layer inside the potato.