Missing bos_token_id in config.json
#2
by
TouchNight
- opened
In Qwen2's config.json, there is "bos_token_id": 151643, but it is not shown here.
Let me investigate. Thanks for bringing this up.
Can confirm that this doesn't have any effect on generation. You can add it to the config if you'd like.
migtissera
changed discussion status to
closed
It means GGUF's generated from this repo don't work. People are hacking their llama.cpp to not require a bos_token because of this issue. GGUF makers should be fixing it, but an upstream fix would make things much easier.
I can add it to the config if that fixes the issue. But I recommend you to use v2.5.2 now.