Spaces:
Running
on
CPU Upgrade
! Eval error in Llama3.3 70b based model
Model_id: ehristoforu/della-70b-test-v1
Failed request: https://huggingface.co/datasets/open-llm-leaderboard/requests/blob/main/ehristoforu/della-70b-test-v1_eval_request_False_float16_Original.json
Even 7b mistral v0.2 is failing (it started 2 days ago). Tried to test already tested model - same fail.
https://huggingface.co/datasets/open-llm-leaderboard/requests/blob/main/icefog72/Ice0.77-02.02-RP_eval_request_False_bfloat16_Original.json
https://huggingface.co/datasets/open-llm-leaderboard/results/tree/main/icefog72/Ice0.77-02.02-RP
Hi @ehristoforu and @icefog72 ,
I checked the logs for ehristoforu/della-70b-test-v1, there was a CUDA error, and the same for icefog72/Ice0.77-02.02-R model. I'll fix the evaluation myself and get back with the results
@alozowski
no need to test my Ice0.77-02.02-RP again, just look why it's beginning to fail, thx