Hugging Face's logo

Qwen
/
Qwen2-72B-Instruct-GGUF

Text Generation
GGUF
English
instruct
chat
Inference Endpoints
imatrix
conversational
Model card Files Community
2
JustinLin610 commited on
Commit
f7c1a08
·
verified ·
1 Parent(s): 455f9f5

Upload folder using huggingface_hub

Browse files
Files changed (15) hide show
  1. qwen2-72b-instruct-fp16-00001-of-00004.gguf +3 -0
  2. qwen2-72b-instruct-fp16-00002-of-00004.gguf +3 -0
  3. qwen2-72b-instruct-fp16-00003-of-00004.gguf +3 -0
  4. qwen2-72b-instruct-fp16-00004-of-00004.gguf +3 -0
  5. qwen2-72b-instruct-q2_k.gguf +3 -0
  6. qwen2-72b-instruct-q3_k_m.gguf +3 -0
  7. qwen2-72b-instruct-q4_0.gguf +3 -0
  8. qwen2-72b-instruct-q5_0-00001-of-00002.gguf +3 -0
  9. qwen2-72b-instruct-q5_0-00002-of-00002.gguf +3 -0
  10. qwen2-72b-instruct-q5_k_m-00001-of-00002.gguf +3 -0
  11. qwen2-72b-instruct-q5_k_m-00002-of-00002.gguf +3 -0
  12. qwen2-72b-instruct-q6_k-00001-of-00002.gguf +3 -0
  13. qwen2-72b-instruct-q6_k-00002-of-00002.gguf +3 -0
  14. qwen2-72b-instruct-q8_0-00001-of-00002.gguf +3 -0
  15. qwen2-72b-instruct-q8_0-00002-of-00002.gguf +3 -0
qwen2-72b-instruct-fp16-00001-of-00004.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:72b8ad0b54e75e0303569d5b249c7cd39a21f70d9ca253e50bf680cd7ddd0c95
3
+ size 37605849472
qwen2-72b-instruct-fp16-00002-of-00004.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:60181ee05cb4dd43391c095b42fa1329fbdfb047e501778747963f32ba97b768
3
+ size 37650365120
qwen2-72b-instruct-fp16-00003-of-00004.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7b57e1a08f6131c169b7ddde1554b18af87b8a7393c1447f57f1cb6404135afd
3
+ size 37832808864
qwen2-72b-instruct-fp16-00004-of-00004.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1557822d2df8d955c71fb6d902ad51c62a67229e4b99417e4b78a01bd3051daa
3
+ size 32333647520
qwen2-72b-instruct-q2_k.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9bf3ea2c089ea12d07d844e433548da205f1623f54f5afb8acecacc44fcf663f
3
+ size 29811760000
qwen2-72b-instruct-q3_k_m.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:121866a3a034308580c6fef7ef146648de07eb816f75679808e6c1086ce8e478
3
+ size 37698722688
qwen2-72b-instruct-q4_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d934fa5cc3cad1115cc70246643c4e23c99d6920dfc4d29e0d472d468cf329d5
3
+ size 41383123840
qwen2-72b-instruct-q5_0-00001-of-00002.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7fd33e9ca259a1ff22e4a0439d0b889dbd12f66e257f73cc2960459258d39b2e
3
+ size 25861010528
qwen2-72b-instruct-q5_0-00002-of-00002.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f80776af63421d7630ba86a0021479becdc7ff4149af9f652dcc9194c73c639b
3
+ size 24454408160
qwen2-72b-instruct-q5_k_m-00001-of-00002.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:866908146adb80facf278d182ce2021c1bacfb28e9e9ec72b68abce323fb99eb
3
+ size 29877009184
qwen2-72b-instruct-q5_k_m-00002-of-00002.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2f1102203846359388ad1a64b52da2819803126781215883ec95b426aebcf9eb
3
+ size 24570454304
qwen2-72b-instruct-q6_k-00001-of-00002.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d7022ebf0dac8f32fb4ac3910ff8dc678e03ef002d07d092f4ddd3f82488fa79
3
+ size 33991603648
qwen2-72b-instruct-q6_k-00002-of-00002.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c3dd358d22815e53a6f8baf7b60a9962113c8cc5cd781da1eb11a81e986fb7f1
3
+ size 30356022912
qwen2-72b-instruct-q8_0-00001-of-00002.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0762958c6a93346f48d1ce39eea4682ecf941ccabaab0b44f1267951fa4cf9d3
3
+ size 39984739488
qwen2-72b-instruct-q8_0-00002-of-00002.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:dacca49adeb6ef812e48ba452c473eb4b27567fd231bf8db73fc800c85066121
3
+ size 37277870016