16k
#1
by
foodsgfse5zhser5h
- opened
Thanks! Any chance of a 4.5bpw quant for 16k ctx @48GB?
I could let the author know you are interested in more quant of this model version, in the meanwhile you can use this 4.8bpw :)
foodsgfse5zhser5h
changed discussion status to
closed
@foodsgfse5zhser5h
The quants are in the same account - It's the latest model we got!
https://huggingface.co/turboderp/Cat-Llama-3-70B-instruct
PotatoOff
changed discussion status to
open
PotatoOff
changed discussion status to
closed