Token leaking and repetition
#3
by
Varkoyote
- opened
Like a lot of other fine-tunes of NeMo, (apart from the incredible Mag Mell), I'm meeting a lot of repetition right from the start, entire messages repeated over. I'm also experiencing some token leaking, with broken stop sequences using Alpaca... I don't know if it's a GGUF problem only, I cannot use the regular version.
Hello! It doesn't stop generation without a system prompt (short Alpaca) for some reason.