Use only one buffer for legacy vertices, optimize case where vertices don't need to be converted (primitives)