Red velvet cake is NOT just a vanilla cake with red food coloring added. While food coloring does give the cake its signature color, the flavor is a bit more complex. Traditional red velvet cake calls for buttermilk, cocoa powder, and vinegar, which gives the cake additional flavor, richness, and a tender texture.