Weird pronoun and anatomy issues
I'll be the first to admit that I'm not that knowledgeable about these things, but I keep running into an odd issue where these line of models built on the whole Stheno Horror model struggles with anatomy and pronouns. I can sometimes fix it with a more restrictive top-p sampling and temperature value, but it seems to overall struggle in that realm regardless of how specific you get in the prompt/memory/world info areas. I also get spawning of random hashtags, OOC, and sometimes it'll number each sentence for whatever reason. Dunno how common these issues are, or how to fix them, but figured I'd give a heads up!
A few other users reported the same. Did you try a different quant(s)?
Also; other versions (grand horror series) may be more suitable.
I just dropped also , Grand Story WTFRack-Instruct (18B) today.
This is stronger in instruction following, and balanced - but it also does horror too.
I would say only a step or two below "Grand Horror" in terms of "horror" output so to speak:
https://huggingface.co/DavidAU/L3-SMB-Grand-Story-WTFrack-Instruct-18.05B-GGUF
( I will be updating the model card shortly )
Nope, I've only tried the 3km quant, so I'll go ahead and see if 4km and 5km has the same issue!
Also, since I kinda do use this model less for horror, I think the other model may actually work a little better for me (although I LOVE the horror potential). Thanks for the tips! I'll report back if I run into the same issues!
Wanted to report back!
Tried 3km, 4km, and 5km quants for Hathor's Revenge and 5km quant for Grand Story WTFrack Instruction. Pronoun issues pretty much consistent regardless of any instructions provided on that end. It seems hardwired to any mention of genitalia. Made extra bizarre/hilarious due to models bias towards butts and anatomical misunderstanding where the human butt is.