Getting "<|eot_id|>" with every prompt
#2
by
SQLExceptionPhil
- opened
Every answer from the LLM has "<|eot_id|>" at the end (and then stops) - even thoguh llama.cpp says:
...
lama-cpp llm_load_print_meta: EOS token = 128009 '<|eot_id|>'
...
using Q4_K_S