Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
compressa-ai
/
Llama-3-8B-Instruct-OmniQuant
like
0
Text Generation
Transformers
Safetensors
llama
llama3
omniquant
gptq
triton
conversational
text-generation-inference
Inference Endpoints
4-bit precision
License:
llama3 (other)
Model card
Files
Files and versions
Community
Train
Deploy
Use this model
1a27dec
Llama-3-8B-Instruct-OmniQuant
2 contributors
History:
2 commits
Vasily Alexeev
add model weights and stuff
1a27dec
5 months ago
.gitattributes
1.52 kB
initial commit
5 months ago
README.md
96 Bytes
initial commit
5 months ago
compressa-config.json
711 Bytes
add model weights and stuff
5 months ago
config.json
897 Bytes
add model weights and stuff
5 months ago
generation_config.json
121 Bytes
add model weights and stuff
5 months ago
model-00001-of-00002.safetensors
4.68 GB
LFS
add model weights and stuff
5 months ago
model-00002-of-00002.safetensors
1.05 GB
LFS
add model weights and stuff
5 months ago
model.safetensors.index.json
78.5 kB
add model weights and stuff
5 months ago
quant_config.json
63 Bytes
add model weights and stuff
5 months ago
special_tokens_map.json
301 Bytes
add model weights and stuff
5 months ago
tokenizer.json
9.08 MB
add model weights and stuff
5 months ago
tokenizer_config.json
51.4 kB
add model weights and stuff
5 months ago