Lewdiculous

/

InfinityRP-v2-8B-GGUF-IQ-Imatrix

like 12

I'm using the built-in Alpaca preset in ST and this model keeps forgetting the closing quotes/asterisk. So far I find TheSpice 0.1.3 to still be the best L3-based finetune in terms of formatting. Tested Q6_K for both.

Temperature: 1.0
Min P: 0.05
Temperature last

From my experience this V2 of Infinity really likes plaintext actions and quotation dialogues, anything outside of that is gonna be a struggle.

I'm waiting for the newest TheSpice which should be coming soon, since cgato has been testing for a while.