vicuna-13b_4_actorder.safetensors
quantization Ops from: /ROCM/MODEL/SD/SD/git_repos/oobabooga_GPTQ/GPTQ-for-LLaMa