Text Generation
Transformers
Safetensors
English
llama
text-generation-inference
4-bit precision
gptq
StableBeluga2-70B-GPTQ / quantize_config.json

Commit History

Update for Transformers GPTQ support
e9b290b

TheBloke commited on

Initial GPTQ model commit
0b41253

TheBloke commited on

Initial GPTQ model commit
3826581

TheBloke commited on