cgato/L3-TheSpice-8b-v0.8.3

#775
by woofwolfy - opened

Can you upload imatrix version? I tried to create imatrix via gguf-my-repo but it doesn't seem to work with imatrix

It's queued! :D

You can check for progress at http://hf.tst.eu/status.html or regularly check the model
summary page at https://hf.tst.eu/model#L3-TheSpice-8b-v0.8.3-GGUF for quants to appear.

It unfortunately seems unlikely that it won't fail as it failed in the past and so I had to force it:

nico1 ~# llmc add force -2000 si https://huggingface.co/cgato/L3-TheSpice-8b-v0.8.3
submit tokens: ["force","-2000","static","imatrix","https://huggingface.co/cgato/L3-TheSpice-8b-v0.8.3"]
https://huggingface.co/cgato/L3-TheSpice-8b-v0.8.3
["https://huggingface.co/cgato/L3-TheSpice-8b-v0.8.3",["static","imatrix","nice","-1000","hf"],1714775192],
https://huggingface.co/cgato/L3-TheSpice-8b-v0.8.3 already in llmjob.submit.txt
forcing.

The only reason I even queued it was because llmc why failed to tell me why it failed which likely happened due to it using regex and the model name contains special characters like dots.

It's queued! :D

You can check for progress at http://hf.tst.eu/status.html or regularly check the model
summary page at https://hf.tst.eu/model#L3-TheSpice-8b-v0.8.3-GGUF for quants to appear.

It unfortunately seems unlikely that it won't fail as it failed in the past and so I had to force it:

nico1 ~# llmc add force -2000 si https://huggingface.co/cgato/L3-TheSpice-8b-v0.8.3
submit tokens: ["force","-2000","static","imatrix","https://huggingface.co/cgato/L3-TheSpice-8b-v0.8.3"]
https://huggingface.co/cgato/L3-TheSpice-8b-v0.8.3
["https://huggingface.co/cgato/L3-TheSpice-8b-v0.8.3",["static","imatrix","nice","-1000","hf"],1714775192],
https://huggingface.co/cgato/L3-TheSpice-8b-v0.8.3 already in llmjob.submit.txt
forcing.

The only reason I even queued it was because llmc why failed to tell me why it failed which likely happened due to it using regex and the model name contains special characters like dots.

Good. Thank you!

llmc why failed to tell me why it failed which likely happened due to it using regex and the model name contains special characters like dots.

No, "." matches "." just fine. There is no fail log for this model, because the static model was quantized back in may. That even predates the submit log, but likely it was only queued for static quants.

mradermacher changed discussion status to closed

Computing imatrix quants was successful and imatrix quants for this model are currently beeing generated! :D

No, "." matches "." just fine. There is no fail log for this model, because the static model was quantized back in may. That even predates the submit log, but likely it was only queued for static quants.

Ah now I understand. I keep forgetting that models you did long time ago might behave strange. In fact the first time I submitted it I did so under the wrong priority and it didn't complain about it already being submitted likely due to it predating the submit log but the next time I submitted to change the priority it mentioned that it was already queued in 3rd of Mai 2024 for booth static and imatrix so I wanted to check why imatrix quants failed not realizing that it was probably simply just queued for static quants only and the submit log entry it showed me being made up.

It's hard to imagine how the same url could cause the grep to work once and fail the other time, but who knows. It's perl/pcre syntax btw.

Your need to confirm your account before you can post a new comment.

Sign up or log in to comment