Examples
#2
by
gcapnias
- opened
Would it be possible to include examples of using the model through web and cli chat, as the original model?
Thanks,
George J.
Hi, George,
It should be possible to use the latest code at https://github.com/QwenLM/Qwen to load the int4 models by changing the -c parameter (it has been updated).
Please also ensure that transformers>=4.32.0 and GPU devices are available (Int4 models are not supported on CPU).
Thanks,
Xuancheng
jklj077
changed discussion status to
closed