Congratulations on the LMEB SOTA! 🎉
#3
by Yuki131 - opened
Congratulations to the NVIDIA Nemotron team! 🚀
The results merged in https://github.com/embeddings-benchmark/results/pull/617 show outstanding LMEB performance:
- Nemotron-3-Embed-8B-BF16: 64.4, a new overall SOTA.
- Nemotron-3-Embed-1B-BF16: 61.5, a new SOTA at the ~1B scale.
The LMEB leaderboard does not appear to have synchronized the newly merged results yet. Based on the merged scores, the 8B and 1B models should rank first and second overall, respectively, once the leaderboard is updated.
ybabakhin changed discussion status to closed
Glad to see the results are live—well deserved! 🎉