Use a size that makes sense for you meal and your family. The key is to cook potatoes that are similar in size so that they finish cooking at the same time. If I'm serving baked potatoes as a main dish, I'll choose large baking potatoes. If the baked potatoes are a side to accompany other things, I'll pick small to medium potatoes.