Fix SummEval scores (https://github.com/embeddings-benchmark/mteb/pull/99)

#4
by Muennighoff - opened
This comment has been hidden
Muennighoff changed pull request title from Fix SummEval scores (https://github.com/embeddings-benchmark/mteb/pull/990) to Fix SummEval scores (https://github.com/embeddings-benchmark/mteb/pull/99)

There was an issue with the SummEval benchmark which affected e5 - I reran e5 with the new code (https://github.com/embeddings-benchmark/mteb/pull/99) & these are the scores I got. Feel free to rerun on your own hardware though & report those scores instead.

intfloat changed pull request status to merged

Sign up or log in to comment