Spaces:

open-llm-leaderboard

/

open_llm_leaderboard

like 11.7k

Running on CPU Upgrade

Hi @MaziyarPanahi ,

Done! I've resubmitted all these three models, please, check

I will close this issue, please, ping me here if you need any help with this model again or open a new discussion

Thanks @alozowski

The following models failed again:

• https://huggingface.co/datasets/open-llm-leaderboard/requests/blob/main/MaziyarPanahi/calme-2.2-rys-78b_eval_request_False_bfloat16_Original.json
• https://huggingface.co/datasets/open-llm-leaderboard/requests/blob/main/MaziyarPanahi/calme-2.1-llama3.1-70b_eval_request_False_bfloat16_Original.json

PS: I wonder if it's timing out due to its file size. It was uploaded as FP32. (I might re-uploaded as FP16)

Hi @MaziyarPanahi ,

Thanks for pinging me!

I resubmitted these models and they are running, hope they will be fine!

Hi @MaziyarPanahi ,

Thanks for pinging me!

I resubmitted these models and they are running, hope they will be fine!

Thanks @alozowski

this model has failed: https://huggingface.co/datasets/open-llm-leaderboard/requests/blob/main/MaziyarPanahi/calme-2.1-rys-78b_eval_request_False_bfloat16_Original.json

Hi @MaziyarPanahi ,

Seems like it was an issue on our side, I've resubmitted the model again – I'll keep an eye on it and leave this discussion open for a while

Thank you @alozowski

I am afraid since these models are FP32, they might timeout during download. If this is not an issue, I avoid re-uploading them in F16.

Many thanks again

That's not an issue, as far as I checked, they are downloading properly when you set bfloat16

Hi @alozowski
Sorry to bother you, but the following model has failed:

https://huggingface.co/datasets/open-llm-leaderboard/requests/blob/main/MaziyarPanahi/calme-2.2-rys-78b_eval_request_False_bfloat16_Original.json

Thanks again :)

Hi @MaziyarPanahi !

I've resubmitted your model, unfortunately it was a network issue, but it should be fine now!