iproskurina
/

opt-350m-GPTQ-4bit-g128

Text Generation

4-bit precision

text-generation-inference

Model card Files Files and versions Community

opt-350m-GPTQ-4bit-g128

1 contributor

History: 17 commits

iproskurina's picture

Update README.md

fc27ab7 verified 3 months ago

.gitattributes

1.52 kB

initial commit about 1 year ago
README.md

2.36 kB

Update README.md 3 months ago
config.json

749 Bytes

AutoGPTQ model for facebook/opt-350m: 4bits, gr128, desc_act=False 3 months ago
merges.txt

456 kB

Add tokenizer for the model opt-350m 3 months ago
model.safetensors

268 MB
LFS

Rename gptq_model-4bit-128g.safetensors to model.safetensors 3 months ago
quantize_config.json

211 Bytes

AutoGPTQ model for facebook/opt-350m: 4bits, gr128, desc_act=False 3 months ago
special_tokens_map.json

548 Bytes

Add tokenizer for the model opt-350m 3 months ago
tokenizer.json

2.11 MB

Add tokenizer for the model opt-350m 3 months ago
tokenizer_config.json

669 Bytes

Add tokenizer for the model opt-350m 3 months ago
vocab.json

798 kB

Add tokenizer for the model opt-350m 3 months ago