add_special_tokens=False results in poor generation
#80
by
DMaksimov
- opened
Hi!
I recently ran an experiment from a model card using a chat template and encountered some issues. In the first attempt, as shown in the attached image, the results were not satisfactory.
However, when I modified the settings to include the token by setting add_special_tokens=True, the outcome improved significantly:
Could you please explain the rationale behind using add_special_tokens=False in this example?