gte-base-en-v1.5 β€” ONNX build for Statelet

ONNX export of Alibaba-NLP/gte-base-en-v1.5, packaged for the dense-retrieval path in Statelet. Weights are unmodified; this repository only re-packages them for ONNX Runtime.

Files

file precision notes
model.onnx fp32 default; loaded on the CPU execution provider
model_gpu_b8_l256_fp16.onnx fp16 static shapes, batch 8 Γ— seq 256, for GPU providers
tokenizer.json β€” HuggingFace fast tokenizer
config.json, pooling_config.json β€” pooling is CLS, not mean

Model details

  • Embedding dimension 768, 12 layers, vocab 30528, max position 8192.
  • Pooling: CLS token (pooling_config.json). Mean-pooling this model gives wrong vectors.

Use in Statelet

STATELET_MODEL_ROOT=/absolute/path/to/models

with this repository placed at $STATELET_MODEL_ROOT/gte-base-en-v1.5, or point at it directly with STATELET_EMBEDDING_MODEL.

Changing the embedder changes the vector dimension, so every existing graph must be re-ingested when switching away from a 768-dim model.

License

Apache-2.0, inherited from the upstream model. See the upstream card for the authoritative terms and citation.

Downloads last month
30
Inference Providers NEW
This model isn't deployed by any Inference Provider. πŸ™‹ Ask for provider support

Model tree for statelet/gte-base-en-v1.5

Quantized
(5)
this model