How to generate with chat with instruct?
#4
by
HelloCephalopod
- opened
Hello, the Instruct models seem to work like completion models with the descriptions given on how to use them. How can they be used as instruct models/chat models? For instance, is there a format like "<s>\n<|user|>Say a sentence about yourself<|user|>\n<|assistant|>" or something that can be used? I've been trying different things like that, and none have worked. It just acts like a completion model.
Could you please give the notebook?
It doesn't look like it's doing well