auto-gptq[llama]
transformers
sentencepiece