VertexLoader: cache NativeVertexFormat

This fix a performance regression of PR #672.