Good model, but it does tend to blow up.
#8
by
Nycoorias
- opened
Overall solid model with good inelegance and prose, but (like felled 80% of Yi fine-tunes) it quickly devolves into word vomit about 400 to 500 tokens in.
Useing TheBlokes gguf 4_k_M version on Koboldcpp with default launcher options and Mirostat 2.
Overall solid model with good inelegance and prose, but (like felled 80% of Yi fine-tunes) it quickly devolves into word vomit about 400 to 500 tokens in.
Useing TheBlokes gguf 4_k_M version on Koboldcpp with default launcher options and Mirostat 2.
I haven't experienced this yet in gguf 4_k_m on lmstudio