Fix Stop Tokens
#2
by
CyberTimon
- opened
No description provided.
Hey there
Here is the PR which fixes the stopping issues with GPT-Q and GGUF quants.
The fix is to set the eos / bos tokens to the config.
Kind regards,
Timon Käch
CyberTimon
changed pull request status to
open
lgtm, ty!
jphme
changed pull request status to
merged