Add minor reference to transformers
#7
by
osanseviero
HF staff
- opened
No description provided.
from transformers import pipeline
messages = [
{"role": "system", "content": "You are a pirate chatbot who always responds in pirate speak!"},
{"role": "user", "content": "Who are you?"},
]
chatbot = pipeline("text-generation", model="mistralai/Mistral-7B-Instruct-v0.3")
chatbot(messages)
how about using this?
Good idea, updated!
patrickvonplaten
changed pull request status to
merged
I think there is no system message on mistral 7b
FYI this example won't ever work with the files currently in the repo. If you look at tokenizer_config.json
, specifically chat_template
field, it will raise error on messages as specified because tokenizer expects user/assistant/user... order