reserved_special_token_49
#2
by
MaziyarPanahi
- opened
There currently is an issue with the model generating random reserved special tokens (like "<|reserved_special_token_49|>") at the end. Please use with skip_special_tokens=true. We will update once we found the reason for this behaviour. If you found a solution, please let us know!
Hi,
Since you use Axolotl, would be great if you can share what caused this issue and how you are trying to fix it.
Thanks again for sharing