TheBloke
/

StableBeluga2-70B-GPTQ

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions Community

StableBeluga2-70B-GPTQ / quantize_config.json

Commit History

Update for Transformers GPTQ support

b267bcc

TheBloke commited on Aug 20, 2023

Initial GPTQ model commit

a1a3179

TheBloke commited on Jul 23, 2023

Initial GPTQ model commit

229a697

TheBloke commited on Jul 22, 2023