Still broken

#1
by Apel-sin - opened

The model still suddenly stops generating :( Version 34fails-3000total is broken too.
Try these queries: https://huggingface.co/datasets/cosmicvalor/toxic-qna?row=6

Edgerunners org

forcing min_length to 150 in silly-tavern seems to resolve this, but I have another idea I'll explore in the coming days, mainly cutting down and hand picking instructs

Can I help u?
PS: I use tabbyAPI as server and LibreChat as client

Edgerunners org

yeah you can, by testing new releases haha, eventually it'll have it all, right now setting min_length sent to tabby via sillytavern works as is

Sign up or log in to comment