upstage/open-ko-llm-leaderboard · Issues in the disappearance of the model

Oct 28, 2023

•

edited Oct 28, 2023

I definitely uploaded the model to evaluate it, but it disappeared without evaluation, so I loaded the model again, but it was not accepted as a submitted model.

The model name is "DopeorNope/COKAL-13b-v1"

Of course I know it's failed, but I don't know why it's failed.

Best Regards,

choco9966

upstage org Oct 29, 2023

•

edited Oct 29, 2023

Hello. Can you check if there are any issues when running the code below?

from transformers import AutoConfig, AutoModel, AutoTokenizer
config = AutoConfig.from_pretrained("your model name", revision=revision)
model = AutoModel.from_pretrained("your model name", revision=revision)
tokenizer = AutoTokenizer.from_pretrained("your model name", revision=revision)

The actual error occurred when loading above code.

I know that for failed models, resubmission is possible. Could you try again? If you encounter problems with the submission even after trying again, please let me know in the comments. I will resubmit the model myself in that case.

Thanks

choco9966 changed discussion status to closed Nov 2, 2023