Text Generation
Transformers
Safetensors
English
mistral
text-generation-inference
4-bit precision
awq
dolphin-2.6-mistral-7B-AWQ / added_tokens.json
TheBloke's picture
AWQ model commit
5812bec
{
"<|im_start|>": 32000
}