TheBloke
/

openchat_3.5-GGUF

text-generation-inference

Model card Files Files and versions Community

Resources

View closed (0)

These models that use rope behave very weird (dumb) with default settings of 32768 in latest Oobabooga text generation webui.

#6 opened 6 months ago by

I really need help with Templates? How to interpret and use them?

#5 opened 6 months ago by

Free and ready to use openchat_3.5-GGUF model as OpenAI API compatible endpoint

#4 opened 6 months ago by

Llama.cpp's Server crashes when input is long

#3 opened 6 months ago by

Weird issues with the local model, but not with the online demo

#2 opened 6 months ago by

sleepyjoecheated

Prints only reply but when asked something extra it hangs

#1 opened 6 months ago by