yichunkuo
/

falcon-rw-1b-gptq

Text Generation

text-generation-inference

Inference Endpoints

8-bit precision

Model card Files Files and versions Community

falcon-rw-1b-gptq / README.md

yichunkuo's picture

Update README.md

fefdc50 12 months ago

|

373 Bytes

metadata

license: cc-by-4.0

GPTQ quantized falcon-rw-1b

Branch	Bits	GS	Act Order	Damp %	GPTQ Dataset	Seq Len	Size	ExLlama	Desc
main	2048	--	No	8-bit, without Act Order and no grouop size.