The instruct preset and talking for you.

#2
by jackboot - opened

The model has a lot of specific instructions to not talk for the user.. when I used your preset the first thing it did was... drumroll... talk for the user.

As soon as I enabled "use names" all of that went away.

Thanks for sharing that! Do you find it works well with use names even if you remove the system prompt instructions that reference only roleplaying as {{char}}? One of the test cases I use is a group chat where use names is on by default, and occasionally the model would still want to produce text as my character, which I was trying to suppress in the system prompt. I also think I'm going to update my recommended sampler settings soon because I think the high temp, lower min-p is contributing to some issues.
If you don't mind, would you test the model with temp around 1.25, Min-P around 0.8, and freq pen set to 0 and let me know if you think that's an improvement?

I use it normally with 1.5-1.8 temp and .4 min_p.. yea rarely it might talk for you. I re-roll when it does that. I don't find instructing it helps to get rid of it. Will try it on those settings and see what happens.

ok.. with lower temp it is more "subdued" and writes less.. actually when I regen on this temp of 0 and temp of 4 doesn't make much difference for that value of minp

Sign up or log in to comment