The number one reason is over-mixing the batter, causing it to develop too much gluten or decreasing the leavening agents' effectiveness. And as a result, the banana bread comes out hard and rubbery. Another reason is over-baking the banana bread, which results in hard and dry banana bread as well.