Models about w4a4 for LLama-2 family
#2
by
liujingcs
- opened
Thank you for your outstanding work. Could you please provide the W4A4 models for the LLaMA-2 family?
Wait a moment. I will upload the W4A4 quantization parameters of LLaMA-2 family in tomorrow.
Thanks!
I have uploaded the models, please refer to https://huggingface.co/ChenMnZ/OmniQuant/commit/892a4e385dbf714e038e1c073cc226ab85a19002.