Probably best speed to perplexity ratio of any 7b gguf model so far

standard q5km conversions with 8bit output for reference.

Good conversion from bf16 down instead of from f16

calculated imatrix in 8bit, was jsut as good as f16 imatrix

Rename qwen7bq4xs.gguf to qwen7bq4xsoutput6k.gguf

Rename qwen7bq4xsembedding5bitkoutput8bit.gguf to qwen7bq4xsembedding8output8.gguf

Rename qwen7bq4kembeddingbf16outputbf16.gguf to qwen7bq4kembeddingf16outputf16.gguf

Upload 9 files

initial commit