Is it a pretrained/base model or instruct model?
#17
by
Sinsauzero
- opened
seemed like there's no mention about that?
Sinsauzero
changed discussion title from
Is it a pretrained model or chat model?
to Is it a pretrained/base model or instruct model?
Hi there! It should be able to be queried as an instruct and FIM as stated on the model card:
Hello,
There is no chat_template implemented in tokenizer_config.json. I tried manually using the model as instruct by adding my own markers (e.g. [INSTRUCTION]...[/INSTRUCTION] and [RESPONSE]...[/RESPONSE]) and few-shot prompting in a pre-prompt, but after responding to an instruction, the model hallucinates its own instructions and answers to itself.
Would it be possible to add a chat template, as requested in #39, please? 🙂
Thank you.