Fix SummEval scores (https://github.com/embeddings-benchmark/mteb/pull/99)
#4
by
Muennighoff
- opened
This comment has been hidden
Muennighoff
changed pull request title from
Fix SummEval scores (https://github.com/embeddings-benchmark/mteb/pull/990)
to Fix SummEval scores (https://github.com/embeddings-benchmark/mteb/pull/99)
There was an issue with the SummEval benchmark which affected e5 - I reran e5 with the new code (https://github.com/embeddings-benchmark/mteb/pull/99) & these are the scores I got. Feel free to rerun on your own hardware though & report those scores instead.
intfloat
changed pull request status to
merged