The baking soda helps the bread to rise and become airy and light in texture, so it's important not to omit this ingredient. Additionally, baking soda helps to neutralize some of the acids from the banana, which can make the banana bread taste even better.