VertexLoader: cache NativeVertexFormat

This fix a performance regression of PR #672.
Rename this to cache_item ?