This model Rocks!

#8
by nixudos - opened

I just wanted to put my appreciation here for this amazing model!
I've tried quite a lot of 13B models, but this has turned out to be the winner. Good coherence, good reasoning skills and great for Character based chat!

I can recommend using the GGML q6 version found on TheBloke. And use Mirostat 2 setting with a tau of 5 and 0.1 in the last parameter.

I had some weirdness happening with the GPTQ model after a very long chat session, but that might have been because of wrong parameter settings.

Mirostat is incredible with this model

This comment has been hidden

Sign up or log in to comment