No! The food coloring is entirely optional, and is only used to give red velvet cake a deep red color, not change the flavor at all. If you do use food coloring, however, be sure to use only gel food coloring. Liquid food coloring is not concentrated enough to be used in a small amount, so it adds additional unwanted liquid to the cake—and can be bitter in large amounts.