You certainly don’t have to! However, I do recommend it. They’re actually a bit sweeter when they're frozen, and they help to thicken the mixture. Fresh bananas have their own charm, of course. They’re a tad bit creamier and are much easier to blend. But you will notice that difference in taste and texture.