Text Generation
Transformers
Safetensors
mistral
openchat
C-RLFT
conversational
text-generation-inference
4-bit precision
gptq
openchat-3.5-1210-GPTQ / generation_config.json
TheBloke's picture
GPTQ model commit
2220dc3
{
"_from_model_config": true,
"bos_token_id": 1,
"eos_token_id": 32000,
"max_length": 8192,
"pad_token_id": 0,
"temperature": 0.5,
"transformers_version": "4.35.2"
}