Request: Sao10K/MN-12B-Lyra-v4

#75
by isr431 - opened

[Required] Model name:
Sao10K/MN-12B-Lyra-v4

[Required] Model link:
https://huggingface.co/Sao10K/MN-12B-Lyra-v4

[Required] Brief description:
A finetune of Mistral Nemo by Sao10k.

[Required] An image/direct image link to represent the model (square shaped):

lyra.png

Will upload as soon as possible. Will be on the way soon[tm].
It's up:
https://huggingface.co/Lewdiculous/MN-12B-Lyra-v4-GGUF-IQ-Imatrix

Lewdiculous changed discussion status to closed

I'll upload IQ2_S-imat (~2.06 bpw) and IQ2_XXS-imat (~2.5 bpw) too later as an experiment for lowest realistically usable quants.

Sign up or log in to comment