Yes! Using a banana that's not ripe enough will add too much starch to your batter and mess with the texture of your bread.