Text Generation
Transformers
PyTorch
Russian
mistral
Inference Endpoints
text-generation-inference

MESSAGE TEMPLATE

#1
by graphnull - opened

DEFAULT_MESSAGE_TEMPLATE = "{role}\n{content}" in original https://huggingface.co/IlyaGusev/saiga_mistral_7b_lora
but TheBloke use <|im_start|>system\n{system_message}<|im_end|>\n<|im_start|> in https://huggingface.co/TheBloke/saiga_mistral_7b-GGUF
I'm confused

I don't control TheBloke — the original template is the one I used in model training.

Sign up or log in to comment