Hugging Face's logo

duyntnet
/
Qwen2-7B-Instruct-imatrix-GGUF

Text Generation
Transformers
GGUF
English
imatrix
Qwen2-7B-Instruct
Model card Files Community
duyntnet commited on
Commit
029bbf5
•
1 Parent(s): 2384806

Upload 3 files

Browse files
Files changed (4) hide show
  1. .gitattributes +3 -0
  2. Qwen2-7B-Instruct-IQ1_M.gguf +3 -0
  3. Qwen2-7B-Instruct-IQ3_M.gguf +3 -0
  4. Qwen2-7B-Instruct-Q3_K_S.gguf +3 -0
.gitattributes CHANGED
@@ -57,3 +57,6 @@ Qwen2-7B-Instruct-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
57
  Qwen2-7B-Instruct-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
58
  Qwen2-7B-Instruct-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
59
  Qwen2-7B-Instruct-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
 
 
 
 
57
  Qwen2-7B-Instruct-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
58
  Qwen2-7B-Instruct-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
59
  Qwen2-7B-Instruct-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
60
+ Qwen2-7B-Instruct-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
61
+ Qwen2-7B-Instruct-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
62
+ Qwen2-7B-Instruct-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2-7B-Instruct-IQ1_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8f173e4f1d8f67ec9e3e46e3875c27979248d1c122e0c4b5e79a38667d9201f0
3
+ size 2042194080
Qwen2-7B-Instruct-IQ3_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:17b0a8b3f019b10272be32166f6aa490ccc71e1e422491857689c817e56f3189
3
+ size 3574010016
Qwen2-7B-Instruct-Q3_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bb6e903f754c4d02a3dc283bf84523065f8895f98be59e327528f0b288f73f0e
3
+ size 3492366496