Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
iproskurina
/
opt-6.7b-GPTQ-4bit-g128
like
0
Text Generation
Transformers
Safetensors
English
opt
gptq
4-bit precision
text-generation-inference
arxiv:
2210.17323
License:
other
Model card
Files
Files and versions
Community
Train
Deploy
Use this model
main
opt-6.7b-GPTQ-4bit-g128
1 contributor
History:
17 commits
iproskurina
Update README.md
c6967a5
verified
17 days ago
.gitattributes
1.52 kB
initial commit
10 months ago
README.md
2.36 kB
Update README.md
17 days ago
config.json
750 Bytes
AutoGPTQ model for facebook/opt-6.7b: 4bits, gr128, desc_act=False
18 days ago
merges.txt
456 kB
Add tokenizer for the model opt-6.7b
17 days ago
model.safetensors
4.2 GB
LFS
Rename gptq_model-4bit-128g.safetensors to model.safetensors
17 days ago
quantize_config.json
211 Bytes
AutoGPTQ model for facebook/opt-6.7b: 4bits, gr128, desc_act=False
18 days ago
special_tokens_map.json
548 Bytes
Add tokenizer for the model opt-6.7b
17 days ago
tokenizer.json
2.11 MB
Add tokenizer for the model opt-6.7b
17 days ago
tokenizer_config.json
669 Bytes
Add tokenizer for the model opt-6.7b
17 days ago
vocab.json
798 kB
Add tokenizer for the model opt-6.7b
17 days ago