No, it's not just a cake dyed red.Old-fashioned red velvet cakes don't always have food coloring. When you mix an ingredient like buttermilk with cocoa powder and vinegar, a chemical reaction tints the cake a dark red or maroon, or reddish-brown color. Modern recipes often have red food coloring to create a more vibrant color.