ISTA-DASLab
/

Meta-Llama-3-70B-AQLM-2Bit-1x16

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

Meta-Llama-3-70B-AQLM-2Bit-1x16

1 contributor

History: 7 commits

SpiridonSunRotator's picture

SpiridonSunRotator

Update README.md

00d2f33 verified 10 months ago

.gitattributes

1.52 kB

initial commit 10 months ago
README.md

710 Bytes

Update README.md 10 months ago
config.json

9.38 kB

Uploaded Meta-Llama-3-70B with AQLM 1x16 quantization 10 months ago
generation_config.json

126 Bytes

Uploaded Meta-Llama-3-70B with AQLM 1x16 quantization 10 months ago
model-00001-of-00005.safetensors

5 GB
LFS

Uploaded Meta-Llama-3-70B with AQLM 1x16 quantization 10 months ago
model-00002-of-00005.safetensors

4.96 GB
LFS

Uploaded Meta-Llama-3-70B with AQLM 1x16 quantization 10 months ago
model-00003-of-00005.safetensors

4.99 GB
LFS

Uploaded Meta-Llama-3-70B with AQLM 1x16 quantization 10 months ago
model-00004-of-00005.safetensors

4.87 GB
LFS

Uploaded Meta-Llama-3-70B with AQLM 1x16 quantization 10 months ago
model-00005-of-00005.safetensors

2.1 GB
LFS

Uploaded Meta-Llama-3-70B with AQLM 1x16 quantization 10 months ago
model.safetensors.index.json

152 kB

Uploaded Meta-Llama-3-70B with AQLM 1x16 quantization 10 months ago
special_tokens_map.json

73 Bytes

Uploaded tokenizer 10 months ago
tokenizer.json

9.08 MB

Uploaded tokenizer 10 months ago
tokenizer_config.json

50.6 kB

Uploaded tokenizer 10 months ago