neuralmagic
/

zephyr-7b-beta-marlin

Text Generation

Inference Endpoints

text-generation-inference

4-bit precision

Model card Files Files and versions Community

zephyr-7b-beta-marlin / quantization /requirements.txt

robertgshaw2's picture

Create requirements.txt

396feff verified 4 months ago

raw history blame contribute delete

No virus

52 Bytes

	auto-gptq==0.7.1
	torch==2.2.1
	transformers
	protobuf