Spaces:

mteb
/

leaderboard

Running on CPU Upgrade

I think I misunderstood max tokens field on the MTEB leaderboard. Previously I put 512, which was the max length we used in MTEB eval. However, looking at other entries on the leaderboard, it seems to be the field to indicate the max length supported by the model. I have updated all LLM2Vec models accordingly. Please merge the changes at your convenience. Thank you!

vaibhavad changed pull request status to open Apr 20

tomaarsen

Massive Text Embedding Benchmark org Apr 20

Looks good! Thanks for the fix.

tomaarsen changed pull request status to merged Apr 20

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment