int4 please
#8
by
wwey
- opened
int4 please
Whats the benefits of int4?
Whats the benefits of int4?
Can run on low memory GPU, I only have one A6000.
We would be happy to investigate. Could you explain how this differs from https://huggingface.co/SUSTech/SUS-Chat-34B/discussions/1?