Hugging Face's logo

neuralmagic
/
OpenHermes-2.5-Mistral-7B-marlin

Text Generation
Transformers
Safetensors
mistral
nm-vllm
marlin
int4
conversational
Inference Endpoints
text-generation-inference
4-bit precision
gptq
Model card Files Community
OpenHermes-2.5-Mistral-7B-marlin / quantize_config.json

Commit History

Upload folder using huggingface_hub
e8c8a9f
verified

robertgshaw2 commited on