These models that use rope behave very weird (dumb) with default settings of 32768 in latest Oobabooga text generation webui.
5
#6 opened 10 months ago
by
CR2022
![](https://cdn-avatars.huggingface.co/v1/production/uploads/63abbef00ed3c32528509700/N7CUJEuCgYqVU8ntzgggz.jpeg)
I really need help with Templates? How to interpret and use them?
5
#5 opened 10 months ago
by
Goldenblood56
Free and ready to use openchat_3.5-GGUF model as OpenAI API compatible endpoint
1
#4 opened 10 months ago
by
limcheekin
Llama.cpp's Server crashes when input is long
#3 opened 10 months ago
by
Mihaiii
![](https://cdn-avatars.huggingface.co/v1/production/uploads/63a6e46ae27a6dbd485b405f/EYHo0V2eGetuaNLzGtz9-.jpeg)
Weird issues with the local model, but not with the online demo
4
#2 opened 10 months ago
by
sleepyjoecheated
Prints only reply but when asked something extra it hangs
14
#1 opened 10 months ago
by
Pumba2