Hugging Face's logo

Join the conversation

Join the community of Machine Learners and AI enthusiasts.

Sign Up
Back to feed
ashercn97 
posted an update Mar 10
Post
3194
does anyone know what the SOTA in text embedding is? Specifically for like sentence similarity and clustering?

I think that the MTEB leaderboard is super complex. I feel lost looking at it (what metric should I judge by?)
monsoon-nlp

I would say, sort by "Mean (task)" and pick one of those. Or if you can, compare three of the best on your data. That holds unless you need a longer context, or you are in medical or similar field where there are domain-specific models

·
ashercn97

Oh wait this makes sense.

I have created some benchmarks from user data-- maybe i make my own leaderboard haha.

Thanks for the help!

Jean-Luc

Hey, as of now Gemini Embeddings is #1 https://developers.googleblog.com/en/gemini-embedding-text-model-now-available-gemini-api/

·
ashercn97

Yes ive seen! Thank you. My issue is the 100 requests a day..

pendingremove32894

I think it is NV-Embed-v2, with a score of 72.31 on MTEB

·
ashercn97

Oh this is good 2 know!

In this post