neuralmagic
/

zephyr-7b-beta-marlin

Text Generation

Inference Endpoints

text-generation-inference

4-bit precision

Model card Files Files and versions Community

zephyr-7b-beta-marlin / quantization

Commit History

Update quantization/apply_gptq_save_marlin.py

a037bbe
verified

robertgshaw2 commited on Mar 6

Create requirements.txt

396feff
verified

robertgshaw2 commited on Mar 6

Create quantization/apply_gptq_save_marlin.py

a76e9cf
verified

robertgshaw2 commited on Mar 6