ChenMnZ
/

Llama-3-70b-instruct-EfficientQAT-w4g128-GPTQ

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

Llama-3-70b-instruct-EfficientQAT-w4g128-GPTQ

1 contributor

History: 2 commits

ChenMnZ's picture

Upload folder using huggingface_hub

7f98bed verified 7 months ago

.gitattributes

1.52 kB

initial commit 7 months ago
README.md

8.72 kB

Upload folder using huggingface_hub 7 months ago
config.json

1.34 kB

Upload folder using huggingface_hub 7 months ago
model-00001-of-00009.safetensors

4.97 GB
LFS

Upload folder using huggingface_hub 7 months ago
model-00002-of-00009.safetensors

4.89 GB
LFS

Upload folder using huggingface_hub 7 months ago
model-00003-of-00009.safetensors

4.89 GB
LFS

Upload folder using huggingface_hub 7 months ago
model-00004-of-00009.safetensors

4.89 GB
LFS

Upload folder using huggingface_hub 7 months ago
model-00005-of-00009.safetensors

4.89 GB
LFS

Upload folder using huggingface_hub 7 months ago
model-00006-of-00009.safetensors

4.89 GB
LFS

Upload folder using huggingface_hub 7 months ago
model-00007-of-00009.safetensors

4.89 GB
LFS

Upload folder using huggingface_hub 7 months ago
model-00008-of-00009.safetensors

3.35 GB
LFS

Upload folder using huggingface_hub 7 months ago
model-00009-of-00009.safetensors

2.1 GB
LFS

Upload folder using huggingface_hub 7 months ago
model.safetensors.index.json

196 kB

Upload folder using huggingface_hub 7 months ago
quantize_config.json

469 Bytes

Upload folder using huggingface_hub 7 months ago
special_tokens_map.json

439 Bytes

Upload folder using huggingface_hub 7 months ago
tokenizer.json

9.08 MB

Upload folder using huggingface_hub 7 months ago
tokenizer_config.json

51.2 kB

Upload folder using huggingface_hub 7 months ago