samantha get crazy
#3
by
WasamiKirua
- opened
Hi there. I am running the GPTQ version locally. I am using langchain couse i would like to build an application on top of the LLM. anyway i am randomly getting strange answers where part of what it might be the dataset corpus is printed out. the special tokens seems to be correctly set.
any idea ?
Same in oobabooga webui. SillyTavern seems to be fine. samantha-1.2-mistral-7b.Q6_K.gguf
