If the bread is underbaked, this can happen. Make sure your toothpick comes out with only crumbs and no batter. Another reason can be is you have a sneaky family member that takes a peak while baking and slams the oven door. Then it can fall a bit!- Ask around!