iproskurina
/

opt-13b-GPTQ-4bit-g128

Text Generation

4-bit precision

text-generation-inference

Model card Files Files and versions Community

opt-13b-GPTQ-4bit-g128

1 contributor

History: 17 commits

iproskurina's picture

Update README.md

467e149 verified about 2 months ago

.gitattributes

1.52 kB

initial commit 12 months ago
README.md

1.95 kB

Update README.md about 2 months ago
config.json

778 Bytes

AutoGPTQ model for facebook/opt-13b: 4bits, gr128, desc_act=False about 2 months ago
merges.txt

456 kB

Add tokenizer for the model opt-13b about 2 months ago
model.safetensors

7.6 GB
LFS

Rename gptq_model-4bit-128g.safetensors to model.safetensors about 2 months ago
quantize_config.json

211 Bytes

AutoGPTQ model for facebook/opt-13b: 4bits, gr128, desc_act=False about 2 months ago
special_tokens_map.json

548 Bytes

Add tokenizer for the model opt-13b about 2 months ago
tokenizer.json

2.11 MB

Add tokenizer for the model opt-13b about 2 months ago
tokenizer_config.json

669 Bytes

Add tokenizer for the model opt-13b about 2 months ago
vocab.json

798 kB

Add tokenizer for the model opt-13b about 2 months ago