GGUF quants?

#1
by eleius - opened

It seems generating gguf's for this model is not possible as either the pretokenizer is incorrect or not yet supported by llama: https://huggingface.co/mradermacher/JSL-MedMX-7X-GGUF/discussions/1

Any idea?

I would also be interested in GGUF quants if possible

eleius changed discussion status to closed

Sign up or log in to comment