Cannot use in SillyTavern

#1
by isr431 - opened

Hi there, I added the q5 quant to Ollama and tried running it in SIllyTavern but the model is outputting nonsense. I didn't have the same problem with v1.2. I tried different samplers and prompt templates but it's still not functioning correctly.

Tried another quant by mradermacher but it still isn't working

I can confirm it's not working with current koboldcpp 1.79.1 + SillyTavern.

Yes its broken

yeah, version v1.2 works fine but this outputs : . : - . . - -

when fix?

Hi,
I have a issue too. With LM Studio, i have this message:
Failed to send message
Cannot call something that is not a function: got UndefinedValue

But 1.2 work fine

Sign up or log in to comment