2b-it can chat normally, but 7b-it can't
Excuse me, why 2b-it can talk normally, but 7b-it can't:
user
How does the brain work?
model
The brain is a complex organ that works in a a variety of ways. The brain is responsible for everything from the the the the the the the the the the the the the the the the
The brain is divided into two hemispheres hemispheres. The left hemisphere hemisphere hemisphere is responsible for all the tasks that require left hemisphere hemisphere hemisphere hemisphere hemisphere hemisphere hemisphere hemisphere hemisphere hemisphere hemisphere hemisphere hemisphere hemisphere hemisphere hemisphere hemisphere hemisphere hemisphere hemisphere hemisphere hemisphere hemisphere hemisphere hemisphere hemisphere hemisphere hemisphere hemisphere hemisphere hemisphere hemisphere hemisphere hemisphere hemisphere hemisphere hemisphere hemisphere hemisphere hemisphere hemisphere hemisphere hemisphere hemisphere hemisphere hemisphere hemisphere hemisphere hemisphere hemisphere hemisphere hemisphere hemisphere hemisphere hemisphere hemisphere hemisphere hemisphere hemisphere hemisphere hemisphere hemisphere hemisphere hemisphere hemisphere hemisphere hemisphere hemisphere hemisphere hemisphere hemisphere hemisphere hemisphere hemisphere hemisphere hemisphere hemisphere hemisphere hemisphere hemisphere hemisphere hemisphere hemisphere hemisphere hemisphere hemisphere hemisphere hemisphere hemisphere hemisphere hemisphere hemisphere hemisphere hemisphere hemisphere hemisphere hemisphere hemisphere hemisphere hemisphere hemisphere hemisphere hemisphere hemisphere hemisphere hemisphere hemisphere hemisphere hemisphere hemisphere hemisphere hemisphere hemisphere hemisphere hemisphere hemisphere hemisphere hemisphere hemisphere hemisphere hemisphere hemisphere hemisphere hemisphere hemisphere hemisphere hemisphere hemisphere hemisphere hemisphere hemisphere hemisphere hemisphere hemisphere hemisphere hemisphere hemisphere hemisphere hemisphere hemisphere hemisphere hemisphere hemisphere hemisphere hemisphere hemisphere hemisphere hemisphere hemisphere hemisphe
Is this using the right tokenizer + formatting / what sampling settings are you using?
Thank you for your reply. I have solved this problem. I used the default decoding (greedy decoding). This reason is a previous problem with the apply_chat_template, which has been fixed
Fantastic, happy to help!