I am trying to evaluate question answering models on
squad_v2. However, I get the following error below:
HTTPError: 404 Client Error: Not Found for url: https://api-staging.autotrain.huggingface.co/projects/1655/data/squad_v2?type=dataset&config_name=squad_v2&split_name=validation Traceback: File "/home/user/.local/lib/python3.8/site-packages/streamlit/scriptrunner/script_runner.py", line 554, in _run_script exec(code, module.__dict__) File "/home/user/app/app.py", line 564, in <module> data_json_resp = http_post( File "/home/user/app/utils.py", line 45, in http_post response.raise_for_status() File "/home/user/.local/lib/python3.8/site-packages/requests/models.py", line 1021, in raise_for_status raise HTTPError(http_error_msg, response=self)
Thanks for reporting! I'll take a look at what's causing this and report back with a fix :)
Is there a way to check the status of the evaluation? I submitted it a couple of hours ago, but didn't get a notification (yet). It also does not seem to be in the autoevaluate/leaderboards.
Hey @timbmg thanks for resubmitting! There is an issue on our infra at the moment, which is why you haven't received a notification yet. We're looking into this and will report back once it's back online!
Regarding checking the status of the evaluation, this isn't currently possible outside the HF team. I'll discuss internally to see if there's a simple solution we can provide!