Del Request: ytgui/Qwen3.5-Sonnet-9B

#2422
by ytgui - opened

Hi,

I noticed your repos are auto-generated quantized versions of my model. I kindly request deletion or regeneration based on the latest version.

The original model is actively updated, and the chat template has been revised, but this quantized repo does not follow the latest changes. Also, the 2–3 bit quantization significantly degrades tool-calling capability, which is a core feature of my work.

Please consider removing or updating this repository.

Hey, I requeued it and you may have already received notification email. The current repositories are removed and being requantized using your updated model. As I said (if you havent received the email notification), I will not be using your gguf as a base as the highest quant is q8, but rather will regenerate using your original updated repository. I cannot do anything about q2 and q3 quants quality, as obviously it's an inherent tradeoff quality vs quantization

You can check for progress at http://hf.tst.eu/status.html or regularly check the model
summary page at https://hf.tst.eu/model#Qwen3.5-Sonnet-9B-GGUF for quants to appear.

thanks, the re-quant can produce much better models πŸ˜€

ytgui changed discussion status to closed

let me know if anything more is needed =)
feel free to ask for more model quants =)

Sign up or log in to comment