Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
nisten
/
qwenv2-7b-inst-imatrix-gguf
like
3
GGUF
License:
apache-2.0
Model card
Files
Files and versions
Community
Use this model
6da7eb9
qwenv2-7b-inst-imatrix-gguf
1 contributor
History:
10 commits
nisten
standard q5km conversions with 8bit output for reference.
6da7eb9
verified
about 1 month ago
.gitattributes
2.43 kB
standard q5km conversions with 8bit output for reference.
about 1 month ago
8bitimatrix.dat
4.54 MB
LFS
calculated imatrix in 8bit, was jsut as good as f16 imatrix
about 1 month ago
README.md
1.55 kB
Update README.md
about 1 month ago
qwen7bf16.gguf
15.2 GB
LFS
Upload 9 files
about 1 month ago
qwen7bq4kembeddingf16outputf16.gguf
6.11 GB
LFS
Rename qwen7bq4kembeddingbf16outputbf16.gguf to qwen7bq4kembeddingf16outputf16.gguf
about 1 month ago
qwen7bq4koutput8bit.gguf
4.82 GB
LFS
Upload 9 files
about 1 month ago
qwen7bq4xsembedding8output8.gguf
4.64 GB
LFS
Rename qwen7bq4xsembedding5bitkoutput8bit.gguf to qwen7bq4xsembedding8output8.gguf
about 1 month ago
qwen7bq4xsoutput6k.gguf
4.22 GB
LFS
Rename qwen7bq4xs.gguf to qwen7bq4xsoutput6k.gguf
about 1 month ago
qwen7bq4xsoutput8bit.gguf
4.35 GB
LFS
Upload 9 files
about 1 month ago
qwen7bv2instruct_q5km.gguf
5.58 GB
LFS
standard q5km conversions with 8bit output for reference.
about 1 month ago
qwenv2instruct7b_q8.gguf
8.1 GB
LFS
Good conversion from bf16 down instead of from f16
about 1 month ago