Quantized versions
#5
by
tDudu78
- opened
Could you add the quantized versions ?
has been done here :
https://huggingface.co/dunzhang/stella_en_400M_v5/tree/refs%2Fpr%2F3
Hi, More quantized models is on the way!
this gguf doesnt work :(
has been done here :
https://huggingface.co/dunzhang/stella_en_400M_v5/tree/refs%2Fpr%2F3
I do not see gguf models in folder.