Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
iproskurina
/
opt-6.7b-GPTQ-4bit-g128
like
0
Text Generation
Transformers
Safetensors
English
opt
gptq
4-bit precision
text-generation-inference
arxiv:
2210.17323
License:
other
Model card
Files
Files and versions
Community
Train
Deploy
Use this model
c3c2d7e
opt-6.7b-GPTQ-4bit-g128
1 contributor
History:
4 commits
iproskurina
Rename gptq_model-4bit-128g.safetensors to model.safetensors
c3c2d7e
11 months ago
.gitattributes
Safe
1.52 kB
initial commit
11 months ago
config.json
Safe
750 Bytes
Upload of AutoGPTQ quantized model
11 months ago
merges.txt
Safe
456 kB
Upload tokenizer
11 months ago
model.safetensors
Safe
4.2 GB
LFS
Rename gptq_model-4bit-128g.safetensors to model.safetensors
11 months ago
quantize_config.json
Safe
245 Bytes
Upload of AutoGPTQ quantized model
11 months ago
special_tokens_map.json
Safe
548 Bytes
Upload tokenizer
11 months ago
tokenizer.json
Safe
2.11 MB
Upload tokenizer
11 months ago
tokenizer_config.json
Safe
669 Bytes
Upload tokenizer
11 months ago
vocab.json
Safe
798 kB
Upload tokenizer
11 months ago