cortecs
/

Llama-3-SauerkrautLM-70b-Instruct-GPTQ-8b

Text Generation

Inference Endpoints

text-generation-inference

8-bit precision

Model card Files Files and versions Community

Llama-3-SauerkrautLM-70b-Instruct-GPTQ-8b

1 contributor

History: 5 commits

markoarnauto's picture

Upload README.md with huggingface_hub

22a2aba verified 29 days ago

.gitattributes

1.52 kB

initial commit about 1 month ago
README.md

8.22 kB

Upload README.md with huggingface_hub 29 days ago
config.json

1.04 kB

GPTQ commit model & tokenizer about 1 month ago
gptq_model-8bit-128g-00001-of-00008.safetensors
9.99 GB
LFS

GPTQ commit model & tokenizer about 1 month ago
gptq_model-8bit-128g-00002-of-00008.safetensors
9.79 GB
LFS

GPTQ commit model & tokenizer about 1 month ago
gptq_model-8bit-128g-00003-of-00008.safetensors
9.88 GB
LFS

GPTQ commit model & tokenizer about 1 month ago
gptq_model-8bit-128g-00004-of-00008.safetensors
9.88 GB
LFS

GPTQ commit model & tokenizer about 1 month ago
gptq_model-8bit-128g-00005-of-00008.safetensors
9.96 GB
LFS

GPTQ commit model & tokenizer about 1 month ago
gptq_model-8bit-128g-00006-of-00008.safetensors
9.95 GB
LFS

GPTQ commit model & tokenizer about 1 month ago
gptq_model-8bit-128g-00007-of-00008.safetensors
9.88 GB
LFS

GPTQ commit model & tokenizer about 1 month ago
gptq_model-8bit-128g-00008-of-00008.safetensors
4.97 GB
LFS

GPTQ commit model & tokenizer about 1 month ago
gptq_model-8bit-128g.safetensors.index.json

232 kB

GPTQ commit model & tokenizer about 1 month ago
quantize_config.json

267 Bytes

GPTQ commit model & tokenizer about 1 month ago
special_tokens_map.json

439 Bytes

GPTQ commit model & tokenizer about 1 month ago
tokenizer.json

9.09 MB

GPTQ commit model & tokenizer about 1 month ago
tokenizer_config.json

51.1 kB

GPTQ commit model & tokenizer about 1 month ago