catid
/

cat-llama-3-8b-awq-q128-w4-gemm

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

cat-llama-3-8b-awq-q128-w4-gemm

Commit History

Update README.md

5c8f159
verified

catid commited on Apr 19

Update README.md

431c053
verified

catid commited on Apr 19

specific version

94b862b

catid commited on Apr 19

fix generation_config.json

e6b4ef0

catid commited on Apr 19

Update README.md

7a52f00
verified

catid commited on Apr 19

Merge branch 'main' of hf.co:catid/cat-llama-3-8b-awq-q128-w4-gemm

1039b19

catid commited on Apr 19

Update README.md

588ef64
verified

catid commited on Apr 19

add model

f645d8c

catid commited on Apr 19

Create README.md

0465785
verified

catid commited on Apr 19

initial commit

9ec8175
verified

catid commited on Apr 19