The cake batter ice cream at Cold Stone tastes like, well, frozen cake batter! It's the perfect base for any number of mix-ins. Some may describe it as a combination of butter and vanilla, which makes it taste like yellow cake mix before it has been baked.