Will quantized versions be available?
#8
by
supercharge19
- opened
How is this model quantized and will quantized model be compatible with llama.cpp? If not then how can quantized model be used? Thanks
The community is discussing about creating quantised versions of the model under this thread -- https://huggingface.co/CohereForAI/aya-101/discussions/12
Feel free to join the discussion there.
I'm closing this as there's already another active thread for this topic.
shivi
changed discussion status to
closed