TheBloke
/

Wizard-Vicuna-30B-Uncensored-GPTQ

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions Community

Wizard-Vicuna-30B-Uncensored-GPTQ / quantize_config.json

Commit History

Update for Transformers GPTQ support

56a82ec

TheBloke commited on Aug 21, 2023

Upload new GPTQs with varied parameters

d48c612

TheBloke commited on Jul 13, 2023

Update quantize_config.json (#3)

0e93fa4

stanbiryukov commited on May 30, 2023

Create quantize_config.json

1cf62db

TheBloke commited on May 30, 2023