Nope, you can leave that layer out if you prefer. I think it gives more of that banana pudding taste and texture but you can skip that if you prefer and just put down a layer of sliced bananas.