qwenv2-7b-inst-imatrix-gguf / qwen7bv2inst_iq4xs_embedding8_outputq8.gguf

great quant if your chip has 8bit acceleration, slightly better than 4k embedding

0bc4249 verified 5 months ago

4.64 GB

This file is stored with Git LFS . It is too big to display, but you can still download it.

Git Large File Storage (LFS) replaces large files with text pointers inside Git, while storing the file contents on a remote server. More info.