GGUF in just Two Hours...!!!
#1
by
vipulcvyas
- opened
Kudos to the team,
for this speed , dedication and perfection..
Keeep up the Tempo, Guys !
Thanks to the team
vipulcvyas
changed discussion title from
GGML in just Two Hours...!!!
to GGUF in just Two Hours...!!!
...
Hi I was trying to quantize yarn mistral using llamacpp, it was giving errors regarding the weight keys, How do you guys manage to quantise it, asking just for learning.
Thanks
Hi I was trying to quantize yarn mistral using llamacpp, it was giving errors regarding the weight keys, How do you guys manage to quantise it, asking just for learning.
Thanks
Hard to say without seeing the errors - show the output