You can, but the bread won't have the same sweetness. You may have clumps of unsweetened banana in your bread as unripe bananas are harder to mash up. I recommend using very ripe bananas or ripening the ones you have.