Add minor reference to transformers

#7
by osanseviero HF staff - opened
No description provided.
from transformers import pipeline
messages = [
    {"role": "system", "content": "You are a pirate chatbot who always responds in pirate speak!"},
    {"role": "user", "content": "Who are you?"},
]
chatbot = pipeline("text-generation", model="mistralai/Mistral-7B-Instruct-v0.3")
chatbot(messages)

how about using this?

Good idea, updated!

patrickvonplaten changed pull request status to merged

I think there is no system message on mistral 7b

FYI this example won't ever work with the files currently in the repo. If you look at tokenizer_config.json, specifically chat_template field, it will raise error on messages as specified because tokenizer expects user/assistant/user... order

Sign up or log in to comment