Diaper manufacturing companies have size charts for diapers according to the infants age. So, depending on which brand you use, you could look at the size chart and decide. Diapers not fully covering the babys bottom, the baby showing signs of distress, and the presence of red marks on your babys thighs and waist are a few signs that may indicate that the baby isnt wearing the correct diaper size.