Adopt MTEB dataset naming scheme

#1
by tomaarsen HF staff - opened

Hello!

Pull Request overview

  • Update the metadata to the MTEB-accepted format
  • Add ai-forever/ruRoberta-large as the base model

Details

I noticed that this model does not yet show up on MTEB. After a bit of investigations, it seems that it's because the dataset names in the metadata don't correspond exactly with the dataset names from MTEB: https://huggingface.co/spaces/mteb/leaderboard/blob/main/config.yaml#L377-L398
This PR addresses that. I tested it locally with a private clone of this model README. You should rank #3 overall. Congratulations!

image.png

  • Tom Aarsen
ai-forever changed pull request status to merged

I've refreshed MTEB for you, you're on there now.

  • Tom Aarsen

Sign up or log in to comment