qwenv2-7b-inst-imatrix-gguf / qwen7bv2inst_iq4xs_embedding4xs_output6k.gguf

Commit History

standard iq4xs imatrix quant from bf16 gguf so it has better perplexity
51abeba
verified

nisten commited on