Too much moisture is the most likely reason your apple bread is falling apart. If the apples are producing too much moisture, you will have to compensate by reducing the milk in the recipe by 1-2 tablespoons. One of the other reasons is not baking the bread as soon as the batter is ready. Letting it sit too long will cause the ingredients to start to break down, causing problems with the bread.