VertexLoader: cache NativeVertexFormat

This fix a performance regression of PR #672.
Or map_entry, to make all these iteration loops consistent in the file.