Spaces:

mteb

/

leaderboard

like 4.07k

Running on CPU Upgrade

app.py crashes, one of the keys is missing

MODEL Model Name: aident-ai/bge-base-en-onnx, Tags: ['sentence-transformers', 'pytorch', 'onnx', 'bert', 'en', 'arxiv:2309.07597', 'feature-extraction', 'sentence-similarity', 'transformers', 'mteb', 'license:mit', 'region:us'], Task: feature-extraction
Traceback (most recent call last):
  File "/root/leaderboard/app.py", line 1031, in <module>
    get_mteb_average()
  File "/root/leaderboard/app.py", line 856, in get_mteb_average
    DATA_OVERALL = get_mteb_data(
  File "/root/leaderboard/app.py", line 827, in get_mteb_data
    task_results = [sub_res for sub_res in meta["model-index"][0]["results"] if (sub_res.get("task", {}).get("type", "") in tasks) and any([x in sub_res.get("dataset", {}).get("name", "") for x in datasets])]
KeyError: 'model-index'