Hugging Face's logo

solidrust
/
Nous-Hermes-2-Mistral-7B-DPO-AWQ

Text Generation
Transformers
Safetensors
PyTorch
English
mistral
finetuned
quantized
4-bit precision
AWQ
instruct
conversational
Inference Endpoints
text-generation-inference
finetune
chatml
DPO
RLHF
gpt4
synthetic data
distillation
awq
Model card Files Community
1
Nous-Hermes-2-Mistral-7B-DPO-AWQ / quant_config.json

Commit History

Add missing quant_config.json for compatibility with vLLM backends out of the box.
aa2a3bf
verified

vaclavkosar commited on