Create quant_config.json
#1
by
uvik
- opened
Adds quant_config.json for vllm quantization compatibility.
@squeeze-ai-lab @Sehoon Can you add this quant config file for usage in vLLM?
Hey @uvik thanks for the comment! we just added it
Thanks!
uvik
changed pull request status to
closed