quantized versions?

#2
by cameronbergh - opened

I am wondering if it will be possible to convert this to GGUF for inference?

Here: https://huggingface.co/TheBloke/deepseek-coder-33B-instruct-GGUF

I think, the files will be there soon.

Chester111 changed discussion status to closed

Sign up or log in to comment