TheBloke
/

StableBeluga2-70B-GPTQ

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions Community

StableBeluga2-70B-GPTQ / quantize_config.json

Commit History

Update for Transformers GPTQ support

4e8d76e

TheBloke commited on Aug 20, 2023

Initial GPTQ model commit

7a5cbca

TheBloke commited on Jul 23, 2023

Initial GPTQ model commit

e75cb48

TheBloke commited on Jul 22, 2023