Why Models are not getting evaluated?

#376
by ajibawa-2023 - opened
Open LLM Leaderboard org

Hi!
Did you check the FAQ? :)
You need to find the request files for your model and tell us what they say.

Hi,
Till now no request file is available. Yes, I have checked FAQ. Thanks

Open LLM Leaderboard org

If no request file is available, then your models were not submitted to the leaderboard - which messages did you get when submitting?

I got message that Model is submitted successfully & will reflect in 1 hour on the list.

Open LLM Leaderboard org

Hi!
There were actually request files for all the models you mentioned here, which indicates that they were successfully uploaded and sent to the queue.

Hi, I just resubmitted all the Models!
If they were successfully uploaded and sent to the queue then they lost the way in queue. :)

Open LLM Leaderboard org
edited Nov 15, 2023

Our current queuing system on the cluster sometimes cancels jobs from the leaderboard, so some of your jobs were cancelled and rescheduled - we are working on fixing the display for the users, to make them re-appear in the queue.
Please wait a bit and they all should appear once they have run! Feel free to reopen this if your results have not appeared next week! :)

clefourrier changed discussion status to closed

Hello,
Reopening this thread as :

  1. https://huggingface.co/ajibawa-2023/Uncensored-Jordan-33B
    is still not evaluated.
    Kindly guide.
    Thanks
ajibawa-2023 changed discussion status to open
Open LLM Leaderboard org

Hi! Your model failed to be downloaded - can you upload it in the safetensors format, as required in the submission form?

Ok, surely. Thanks.

ajibawa-2023 changed discussion status to closed
Open LLM Leaderboard org

Ping us when it's done so we can launch the eval again :)

Sign up or log in to comment