Thanks for this great model!
I just tested the 8bpw quant from LoneStriker and wanted to congratule you on this model.
It passed my RP standard tests with flying colors, remembered a lot, summarized well, is creative, proactive and follows the instructions very well. And for context size, this works really good.
Even on a limited 4080 card I could load the EXL2 8bpw quant with 16bit cache, RoPE 1,75 with a ctx of 50k and it works well!
Thank you, it is already one of my favorites.
Great to hear! Thank you so much for trying it out, and glad you're enjoying it!
Have you ko-fi?
This fett and onion 6.0 bpw exl2 are already claude 777 for me... especially min p setting is perfect
really thanks 😭😭😭
Fantastic! Glad to hear you enjoy it so much!
As a matter of fact, I do have a kofi
🥰☕️