You can…but it will make your life a lot easier if you peel them first. I've tried both ways, and trust me, it's not easy to peel a frozen banana. And it's not much better when it thaws and turns into mush.