Issues?
Hi, I am using this for creative writing but it doesn't seem to follow the instructions or world info well, whereas Mini-Magnum-12b does, well it did after some tweaking. I'm using ChatML settings. Any ideas as to what settings I need to use? Cheers
Hiya, can you share a little more about your issue you are facing and or the type of input.
Especially helpful would be your settings which you run the model with as high temperature could be a cause (wild guess)
I heavily suspect it's the sampler settings myself. I'm not at my computer. What do you recommend?
I heavily suspect it's the sampler settings myself. I'm not at my computer. What do you recommend?
Well, it depends what program you use, do you use SillyTavern? Do you use the Direct Ui? I personally recommend the Min_P preset.
Which quant are you runnin?
I was running it on Textgenui UI with twinbook. So I can use the Min_P settings if I know that they should be. I was running the IQ4_N_L quant.
There's a few settings listed online for the 72b version so hopefully they will work.