about awq
#1
by
congbinscb
- opened
i try to use awq to quantize but fail at 97%, i try on deepseek-33B successfully ;
could you share how to quantize on deepseek-coder-6.7B
i try to use awq to quantize but fail at 97%, i try on deepseek-33B successfully ;
could you share how to quantize on deepseek-coder-6.7B