Can you please create a 3-bit file via exllama2?
#3
by
Kotokin
- opened
Can you please create a 3-bit file via exllama2?
Will try to do it when I can, time is a bit tight right now.
Anyone that wants to do it as well, can do it using this model which is already on safetensors https://huggingface.co/Panchovix/airoboros-l2-70b-gpt4-1.4.1-safetensors