There could be many reasons why some of your potatoes are small in comparison to other potatoes. It could be because of improper watering, lack of sunlight, high temperatures, early harvesting, and nutrient deficiency. The size of potatoes can vary from one plant to another or from one potato to another in a single plant.