Yes, you can. The filling will be shorter without the caramel layer, but still taste absolutely delicious! If you like chocolate banana cream pie, you can add a layer of chocolate ganache instead as well.