rep_pen_slope in koboldcpp

#11
by lightning-missile - opened

Hello,

I'm new at local LLMs, I appologise in advance if my question is obvious.

First, I absolutely love this model. I am using it for generating stories.

I am applying your recommended settings in koboldcpp. One of the samplers that it has is the rep_pen_slope. Now I totally have no idea what this is. But in the case of koboldcpp, do you recommend turning this on? Since you have recommended settings for rep_pen and rep_pen_range, it seems like they are connected? The default value is 0.7.

Thanks!

I have never messed with the rep_pen slope before, so the default is probably fine. I'm glad you're enjoying the model!

sophosympatheia changed discussion status to closed

Sign up or log in to comment