Don't sleep on Nous capybara
#3
by
BlueNipples
- opened
Just sayin'. Both the llama-2 version, and the Mistral version are fire. Genuinely great prose and comprehension for RP, especially the mistral version. Proper surprised me these.
I did briefly test this model. Quite promising. Runs better on mobile dGPU than 13b models if you use the 2 bit k-quant. Prose is quite complex, but a little incoherent. Possible with some tuning this could be great for people who sit on the cusp between 7 and 13.
I can confirm from first hand experience that anything @LDJnr has on his repository is a product of meticulous design and expertise