No, your baked oats should not be mushy. Making baked oats without banana helps avoid that mushy texture, but it is also important to make sure that you bake the oats through completely. Stick a toothpick into the center of the oats near the end of baking. If the toothpick is wet, the oats need a longer bake, otherwise they will be mushy.