It doesn't have to, as r,g,b,a in the PackedVertex are set but are never read.  The best thing would be to just remove them, yes.