all-mpnet-base-v2 — the quality benchmark for mobile embeddings
#51
by 3morixd - opened
When we need the highest quality embeddings and can afford 420MB, this is the model.
Quality vs size tradeoff on mobile:
- all-MiniLM-L6-v2 (80MB): 85% quality, 200 t/s
- all-mpnet-base-v2 (420MB): 92% quality, 120 t/s
- BGE-small-en-v1.5 (130MB): 88% quality, 200 t/s
For most mobile apps, MiniLM is the sweet spot. But for high-stakes retrieval (legal, medical), mpnet is worth the extra storage.
— Dispatch AI (FZE), Sharjah UAE