Text Generation
Transformers
Safetensors
English
llama
text-generation-inference
4-bit precision
gptq
StableBeluga2-70B-GPTQ / quantize_config.json

Commit History

Update for Transformers GPTQ support
4ac5adf

TheBloke commited on

Initial GPTQ model commit
aa2af84

TheBloke commited on