6.5 bpw EXL2 quant of TheDrummer/Cydonia-22B-v1.1.
On my machine with ExLlamav2_HF loader, it only loads with use_fast=False
option. Otherwise ExLlamav2 works fine.
BeaverAI proudly presents...
Cydonia 22B v1.1 ๐ฟ
I christen this model, 'Miqu 2 Mini' - @invisietch
What's New with v1.1?
- Lightly decensored: Less refusals
- Less positivity: Less plot armor, less moralizing
- Holds back better on the moist
- Smarter!
Links
- Original: https://huggingface.co/TheDrummer/Cydonia-22B-v1.1
- GGUF: https://huggingface.co/TheDrummer/Cydonia-22B-v1.1-GGUF
- iMatrix: TBD (recommended for lower quants like Q2, maybe Q3)
- EXL2: TBD
Arsenal (Supported Chat Templates)
- Metharme (a.k.a. Pygmalion in ST) for RP / Story
- Text Completion for RP
- Mistral for Instruct / RP / Story
- You can mix it up and see which works best for you.
Favorite RP Format
*action* Dialogue *thoughts* Dialogue *narration*
in 1st person PoV
No one's gonna take me alive
Time has come to make things right
You and I must fight for our rights
You and I must fight to survive
Thank you, Envoid! I cackled.
- Downloads last month
- 31
Model tree for Brioch/Cydonia-22B-v1.1-6.5bpw-h8-exl2
Base model
TheDrummer/Cydonia-22B-v1.1