airoboros-l2-70b-2.1-creative.Q4_0.gguf broken?
#1
by
wolfram
- opened
Only tested the Q4_0 version with koboldcpp-1.43, but this is generating nonsense text for me:
brie◄Ýiglia cabbriebriebriebriebriebriebriebriebriebriebriebriebriebriebriebriebrie (repeating that all the way until max new context limit is reached...)
I checked the file hash to make sure my download didn't get corrupted, and I'm using the same settings as all the other (70B) models I use, so it looks to me like it's a model issue. Anyone able to confirm that or who has this particular file working properly for them?