Now Available in GGUF, AWG & GPTQ format!
#2
by
BoshiAI
- opened
Fellow Faraday Fan Amogus made a full set of GGUF quants for this marvellous model:
https://huggingface.co/WhoTookMyAmogusNickname/Mythalion-Kimiko-v2-GGUF
Then The(Marvellous)Bloke Tom made a full set of quants available in GGUF/AWQ/GPTQ and uploaded them too:
https://huggingface.co/TheBloke/Mythalion-Kimiko-v2-GGUF
https://huggingface.co/TheBloke/Mythalion-Kimiko-v2-GPTQ
https://huggingface.co/TheBloke/Mythalion-Kimiko-v2-AWQ
Thank you both for making this marvellous model more accessible to others!
BoshiAI
changed discussion title from
Now Available in GGUF, GPTQ and AWQ formats!
to Now Available in GGUF formats!
BoshiAI
changed discussion title from
Now Available in GGUF formats!
to Now Available in GGUF format!
BoshiAI
changed discussion title from
Now Available in GGUF format!
to Now Available in GGUF, AWG & GPTQ format!