Spaces:
Running
on
CPU Upgrade
Mixtral 8x22B evaluation failed
The model works on my side, but the evaluation shows that it failed and it says that the model has already been submitted when I try to resubmit.
https://huggingface.co/datasets/open-llm-leaderboard/requests/blob/main/a-normal-username/Mixtral-8x22B-OpenHermes-2.5_eval_request_False_bfloat16_Original.json
Could you help me with this? Thanks!
Hi @a-normal-username !
According to the log, there is a same problem we're discussing here – we need some time to investigate how to launch MoE models. As soon as we find a solution, I'll resubmit your model
Hi @a-normal-username !
Since we can submit Mixtral based models now, I've resubmitted your model. Unfortunately, the research cluster is full right now, so the evaluation may take longer than usual, but hopefully everything will be fine.
I close this discussion, please, ping me here if you encounter any problems with your model
Hi @a-normal-username !
We have fixed the parameter number for your model and sent it out for evaluation, should be fine now 👍