Hugging Face's logo

Qwen
/
Qwen2-7B-Instruct-GGUF

Text Generation
GGUF
English
chat
Model card Files Community
8
JustinLin610 commited on
Commit
ddfd0ef
•
1 Parent(s): f4708fd

Upload folder using huggingface_hub

Browse files
Files changed (9) hide show
  1. qwen2-7b-instruct-fp16.gguf +2 -2
  2. qwen2-7b-instruct-q2_k.gguf +3 -0
  3. qwen2-7b-instruct-q3_k_m.gguf +3 -0
  4. qwen2-7b-instruct-q4_0.gguf +3 -0
  5. qwen2-7b-instruct-q4_k_m.gguf +3 -0
  6. qwen2-7b-instruct-q5_0.gguf +2 -2
  7. qwen2-7b-instruct-q5_k_m.gguf +2 -2
  8. qwen2-7b-instruct-q6_k.gguf +2 -2
  9. qwen2-7b-instruct-q8_0.gguf +2 -2
qwen2-7b-instruct-fp16.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:6df8256ba7781d491a0b3be8790e69dbcc8fd6c8279f10e1b6478ab0995c0e20
3
- size 15237850656
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:38227ded455e508bba9c86c8c793a4352a67c15c93be069d2bd062cd2fdcac2f
3
+ size 15237850688
qwen2-7b-instruct-q2_k.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d5ff4cd09d3accd9ca21bf41580e93190030b066c2fe669afa6887dcad31546e
3
+ size 3015937824
qwen2-7b-instruct-q3_k_m.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:31dca2fb3df2d4981d1d7a011670bfcaf5f22f0ec1d2b9a5fdb81410990fc1b4
3
+ size 3808388896
qwen2-7b-instruct-q4_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c188f9260d419ff6b38c4630f19ffd260caed3559506206ba344aceb9c90f90c
3
+ size 4444118816
qwen2-7b-instruct-q4_k_m.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ed93dfc426f926451fa3ec7f996a787a31cfd97e55d7769568fbffc2d69861c2
3
+ size 4683071264
qwen2-7b-instruct-q5_0.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:d7f0cd83cab30e3d817f285acb5002cb7889281d0fb83d7212b201b22e8e160c
3
- size 5315173920
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:51b81b3f2b9af8415a7a27f8a986d921c7f6ca8a87fe63b51e90142a8bcdc969
3
+ size 5327904544
qwen2-7b-instruct-q5_k_m.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:258dd2fa1bdf98b85327774e1fd36e2268c2a4b68eb9021d71106449ee4ba9d5
3
- size 5444828704
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7aeb11bb9b36d47625bd61514a3ac085826537144b375bb1d66b42738127e425
3
+ size 5444828960
qwen2-7b-instruct-q6_k.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:e4f3ecf4453db5de781ee64e7c4022d79ded6ce84de00621faa02541ff19c3b1
3
- size 6254196256
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0a475cc3b3eb3b9723bd063919273cee7987e84d468347a59c2ed2bded0fb21a
3
+ size 6254196512
qwen2-7b-instruct-q8_0.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:55b1c74b48d4fdf9868f0f7ee06fd2aae4d3a2baf0be474a006e1aa4ab98ab81
3
- size 8098522656
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:945823750c8eb6aa685692753ae90cd9551a56618d03051241268f53cdbd8352
3
+ size 8098522912