LoftQ
/

Meta-Llama-3-70B-Instruct-4bit-64rank

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

Meta-Llama-3-70B-Instruct-4bit-64rank

1 contributor

History: 9 commits

LoftQ's picture

Update README.md

04c3fce verified 7 months ago

loftq_init
Delete loftq_init/loftq_init 7 months ago
.gitattributes

1.52 kB

initial commit 7 months ago
README.md

1.91 kB

Update README.md 7 months ago
config.json

1.2 kB

Update config.json 7 months ago
generation_config.json

194 Bytes

Upload folder using huggingface_hub 7 months ago
model-00001-of-00009.safetensors

4.99 GB
LFS

Upload folder using huggingface_hub 7 months ago
model-00002-of-00009.safetensors

4.9 GB
LFS

Upload folder using huggingface_hub 7 months ago
model-00003-of-00009.safetensors

4.95 GB
LFS

Upload folder using huggingface_hub 7 months ago
model-00004-of-00009.safetensors

4.95 GB
LFS

Upload folder using huggingface_hub 7 months ago
model-00005-of-00009.safetensors

4.99 GB
LFS

Upload folder using huggingface_hub 7 months ago
model-00006-of-00009.safetensors

4.98 GB
LFS

Upload folder using huggingface_hub 7 months ago
model-00007-of-00009.safetensors

4.95 GB
LFS

Upload folder using huggingface_hub 7 months ago
model-00008-of-00009.safetensors

4.99 GB
LFS

Upload folder using huggingface_hub 7 months ago
model-00009-of-00009.safetensors

3.02 GB
LFS

Upload folder using huggingface_hub 7 months ago
model.safetensors.index.json

223 kB

Upload folder using huggingface_hub 7 months ago
special_tokens_map.json

301 Bytes

Upload folder using huggingface_hub 7 months ago
tokenizer.json

9.09 MB

Upload folder using huggingface_hub 7 months ago
tokenizer_config.json

51 kB

Upload folder using huggingface_hub 7 months ago