Sampler Tips for Kobold.cpp?

#4
by Puchacz19 - opened

Hi, I like your model, I use your instruct template and I have a question about Sampler for Kobold. The sliders are different from oobaboba ai. What are your recommendations?

I haven't used Kobold in a long time. If it supports Min-P, then you should be able to mirror the settings.
I like setting MinP between 0.3 and 0.45 with a temperature between 1.2 and 1.45. Play around with combinations in that range. I would set your repetition penalty between 1.1 and 1.2. As long as you can do that, you should get some nice results.

sophosympatheia changed discussion status to closed

Sign up or log in to comment