In my experience, you technically can. But it's just not the same. The bread isn't as moist, and the flavor definitely isn't as sweet. And-- as someone who doesn't love the taste of underripe bananas anyway, I feel like anything baked with underripe bananas tastes funny. So, in a nutshell-- yes, you can. But don't.