Text Generation
Transformers
Safetensors
English
llama
text-generation-inference
4-bit precision
gptq
StableBeluga2-70B-GPTQ / quantize_config.json

Commit History

Update for Transformers GPTQ support
250b428

TheBloke commited on

Initial GPTQ model commit
c88b3a9

TheBloke commited on