neuralmagic
/

OpenHermes-2.5-Mistral-7B-marlin

Text Generation

Inference Endpoints

text-generation-inference

4-bit precision

Model card Files Files and versions Community

OpenHermes-2.5-Mistral-7B-marlin

Commit History

Update README.md

1865eb1
verified

robertgshaw2 commited on Mar 6

Update README.md

8a52c2d
verified

robertgshaw2 commited on Mar 6

Create quantization/requirements.txt

aba357d
verified

robertgshaw2 commited on Mar 6

Create quantization/apply_gptq_save_marlin.py

f57a0ec
verified

robertgshaw2 commited on Mar 6

Create README.md

cc5667e
verified

robertgshaw2 commited on Mar 6

Upload folder using huggingface_hub

e8c8a9f
verified

robertgshaw2 commited on Mar 6

initial commit

69acf9b
verified

robertgshaw2 commited on Mar 6