Yes, you can omit the whey protein, but it helps create a smoother texture and adds a hint of vanilla flavor.