I really need help with Templates? How to interpret and use them?
I use Oobabooga. In the readme it says...
prompt_template: |
GPT4 User: {prompt}<|end_of_turn|>GPT4 Assistant:
How do I use this in instruct mode in Oobabooga? Or do I have to use chat mode? I prefer having a long discussion with the AI not role play but asking questions and getting it to write stories based on what we discussed etc. Kind of like how one would use ChatGPT. Basically how can I add that template into Ooba? I've been to the Instruct template tab. I know how to change templates. But not how to properly format or add new ones etc.
There is an OpenChat template in Oobabooga
User string
GPT4 User:
Bot String
GPT4 Assistant:
Turn template
<|user|> <|user-message|><|end_of_turn|><|bot|> <|bot-message|><|end_of_turn|>
Command for chat-instrruct mode
Continue the chat dialogue below. Write a single reply for the character "<|character|>".
<|prompt|>
But this is not the correct one right? How do I use the one in the readme?
I have same question. How to use System in template?
@Goldenblood56 did you figure out?
No I did not.
I have same question. How to use System in template?
@Goldenblood56 did you figure out?
Try:
Turn template
<|user|> <|user-message|><|end_of_turn|><|bot|> <|bot-message|>
User string
GPT4 User:
Bot string
GPT4 Assistant:
Thank you. I think I stopped using this model but the information provided may still help me. I might try this out. I notice for a lot of models I just choose Alpaca, Guanaco or ChatLm and results pretty good. lol I still don't know how to setup a custom template in Ooba. But this may help me.
did it?