neuralmagic
/

TinyLlama-1.1B-Chat-v1.0-marlin

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

TinyLlama-1.1B-Chat-v1.0-marlin / quantization /requirements.txt

robertgshaw2's picture

Create requirements.txt

c7713ac verified 8 months ago

history blame contribute delete

52 Bytes

	auto-gptq==0.7.1
	torch==2.2.1
	transformers
	protobuf