Hugging Face's logo

nisten
/
qwenv2-7b-inst-imatrix-gguf

GGUF
Inference Endpoints
conversational
Model card Files Community
qwenv2-7b-inst-imatrix-gguf / qwen7bv2inst_Iq4xs_output6k.gguf

Commit History

Standard IQ4XS quantizing down from full bf16 ( not from f16)
bb46d3a
verified

nisten commited on