Request: Sao10K/MN-12B-Lyra-v4
#75
by
isr431
- opened
[Required] Model name:
Sao10K/MN-12B-Lyra-v4
[Required] Model link:
https://huggingface.co/Sao10K/MN-12B-Lyra-v4
[Required] Brief description:
A finetune of Mistral Nemo by Sao10k.
[Required] An image/direct image link to represent the model (square shaped):
Will upload as soon as possible. Will be on the way soon[tm].
It's up:
https://huggingface.co/Lewdiculous/MN-12B-Lyra-v4-GGUF-IQ-Imatrix
Lewdiculous
changed discussion status to
closed
I'll upload IQ2_S-imat (~2.06 bpw
) and IQ2_XXS-imat (~2.5 bpw
) too later as an experiment for lowest realistically usable quants.