Text Generation
Transformers
Safetensors
English
mistral
text-generation-inference
4-bit precision
gptq
dolphin-2.6-mistral-7B-GPTQ / added_tokens.json
TheBloke's picture
GPTQ model commit
5c377c3
{
"<|im_start|>": 32000
}