mteb/leaderboard · Discussions

#113 opened 2 days ago by

aari1995

New C-MTEB Submission Apply for refreshing the results

#112 opened 7 days ago by

shhy1995

i want Hugging Face models that focus on interpreting images and generate a 2-3 line summary based on them.

#107 opened 14 days ago by

ashutosh432

Add German part added in MTEB

8

#87 opened about 2 months ago by

aari1995

Can we publish MTEB results to leaderboard for a subset of tasks only?

#86 opened about 2 months ago by

MichaelKarpe

Machine readable Leaderboard?

#85 opened about 2 months ago by

adirendu

New C-MTEB SOTA! Apply for refreshing the results

#84 opened 2 months ago by

aspire

Language distribution in MTEB

#83 opened 2 months ago by

Maiia

MultiLongDocRetrieval dataset failed to load

#82 opened 2 months ago by

sentosa

When is the leaderboard updated for new models that are uploaded?

#75 opened 3 months ago by

tanmaylaud

Add BGE-M3

#73 opened 3 months ago by

sam-gab

What does `Refresh` functionality do after clicking?

#72 opened 3 months ago by

zhiminy

New Sub-GB SOTA, request for leaderboard refresh

#71 opened 4 months ago by

avsolatorio

incomplete evaluation results

#69 opened 4 months ago by

yin2024

New SOTA! Apply for refreshing the results

9

#64 opened 4 months ago by

memray

New SOTA! Apply for refreshing the results

#62 opened 4 months ago by

mixed-nlp

Why does Spanish is not showed in the leaderboard

#61 opened 4 months ago by

Jowito2000

How to push custom model

#60 opened 4 months ago by

mirth

Runtime error

#57 opened 5 months ago by

zhiminy

Any manner to retrieve the leaderboard results as csv file?

#56 opened 5 months ago by

zhiminy

New SOTA! Apply for refreshing the results

7

#55 opened 5 months ago by

stanpcf

Set height and add model search

#54 opened 5 months ago by

do-me

New SOTA! Apply for refreshing the results

#53 opened 5 months ago by

SeanLee97

Use mteb.info while the space is down

#51 opened 6 months ago by

dhruv-anand-aintech

🚩 Report: Not working

#50 opened 6 months ago by

AlanFeder

Add model size to all tabs

#49 opened 6 months ago by

do-me

Add similarity measure used for each model evaluation

7

#44 opened 7 months ago by

sjrhuschlee

CQADupstackRetrieval evaluation inquiry

4

#41 opened 7 months ago by

Izarel

Only allow 1 instance of a particular model name to be in the list.

#40 opened 7 months ago by

dhruv-anand-aintech

🚩 Report: Not working

#38 opened 7 months ago by

YulianLee

Restart space to add new models

13

#36 opened 7 months ago by

zeroshot

????? Chart topping "Sionic" models do not even begin to meet common-sense minimum expectations for posting here

#35 opened 8 months ago by

spaceman7777

Can a private model be added to the leaderboard?

#29 opened 8 months ago by

Xinyiqin

Restart the space for new models

7

#28 opened 8 months ago by

infgrad

cannot refresh the leaderboard space

#27 opened 9 months ago by

Jinkin

Restart space for MTEB leaderboard

#26 opened 9 months ago by

willathum

Benchmark the text embedding models

#25 opened 9 months ago by

Shimin

Benchmark the latest `SONAR` models from Meta AI

#24 opened 9 months ago by

reach-vb

Which task is most similar to the average? An analysis via the Kendrall Tau coeffcient

#23 opened 9 months ago by

varun4

Why no open source llama/orca/platypus submissions?

#22 opened 9 months ago by

lewington

Multi-language Overall Score

#21 opened 9 months ago by

loretoparisi

unfair comparison

#20 opened 9 months ago by

raulcarlomagno

SGPT models sequence length

#19 opened 9 months ago by

rdroste

Restart the space for new models

#18 opened 10 months ago by

Shitao

Static copy of the leaderboard

#17 opened 10 months ago by

dhruv-anand-aintech

Add size and language to table?

#15 opened 10 months ago by

endolith

Do not see retrieval and sts numbers

#13 opened 11 months ago by

consciousAI

GREAT work, but please add DATES / at least last update date

#12 opened 11 months ago by

ozziko

CLIP Performance