quantized model Version?
#2
by
thanhtan2136
- opened
I hope in future this model can have more ver quantized for LLM deploy
We will release quantized version soon.
Stay tune, a 2B version is coming shortly, same quality, and can run on mobile phone or with CPU !
Cheers,
Nguyên
amazing , thanks for sharing :D I hope can try 2B version
I also wish, hope there will be a version for weak GPU soon, thank you very much developer