GGUFs
#1
by
lemon07r
- opened
Would either of you, @mradermacher or @bartowski mind uploading GGUF quants for me? Thank you! If your queues are already too full that's okay too. I can try uploading my own if my slow upload speeds will cooperate with me long enough to get them up.
It's queued. You can watch its progress through the sysytem at http://hf.tst.eu/status.html
Should take a few hours at most at the moment. Cheers!
You guys are both amazing! Looks like the weird mergekit bug that's adding lm_head (hence my model being 10b, weird mergekit bug with slerp merging gemma 2 models) hasn't affected your quant sizes too, so I'm happy to see that.
lemon07r
changed discussion status to
closed