Transformers
GGUF
English
Inference Endpoints

nice, will you also be making a IQ3_M version or is that still uploading?

#1
by belisarius - opened

l3 70b IQ3_M works really well on my specs with good enough intelligence and speed, so its become my preferred size.

It should be coming - see the faq linked from the model card for a list of quants I regularly provide.

mradermacher changed discussion status to closed

Sign up or log in to comment