It's normal for the streusel to fall off. This pumpkin bread is loaded with streusel on top and it's completely normal for some of it to fall off once you start cutting into it. Just sprinkle it back on top of the loaf and enjoy as usual!