While all 3 cakes are similar, they each have distinct differences that affect their appearance, texture, and flavor. A vanilla bean cake has a robust vanilla flavor from vanilla paste, while yellow and white cakes only contain vanilla extract and, therefore, have a subtle vanilla taste. Yellow cake is a dark yellow color from the addition of egg yolks, while white cake contains just egg whites. Vanilla bean cake sticks with whole eggs only, imparting a creamy color to the batter.