Hugging Face's logo

Qwen
/
Qwen2-1.5B-Instruct-GGUF

Text Generation
GGUF
English
chat
instruct
Inference Endpoints
conversational
Model card Files Community
1
JustinLin610 commited on
Commit
166ad99
•
1 Parent(s): 1fd29b3

Upload folder using huggingface_hub

Browse files
Files changed (9) hide show
  1. qwen2-1_5b-instruct-fp16.gguf +2 -2
  2. qwen2-1_5b-instruct-q2_k.gguf +3 -0
  3. qwen2-1_5b-instruct-q3_k_m.gguf +3 -0
  4. qwen2-1_5b-instruct-q4_0.gguf +3 -0
  5. qwen2-1_5b-instruct-q4_k_m.gguf +3 -0
  6. qwen2-1_5b-instruct-q5_0.gguf +2 -2
  7. qwen2-1_5b-instruct-q5_k_m.gguf +2 -2
  8. qwen2-1_5b-instruct-q6_k.gguf +2 -2
  9. qwen2-1_5b-instruct-q8_0.gguf +2 -2
qwen2-1_5b-instruct-fp16.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:923801c6b56ab77aaea9af0301cbe46b0ce9b90d7658cf814fa9ad73ac995c56
3
- size 3560413856
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c6dbd2dff2af7b981dc19003d2bdca4774b3912c341c9bd5969e5a1dc8bd4398
3
+ size 3093666432
qwen2-1_5b-instruct-q2_k.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7072d042ff33c22b6462c736cc4167ed6f4986543234734eac38bc24dfb9f306
3
+ size 676302208
qwen2-1_5b-instruct-q3_k_m.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2bf42bb404a3d1f76bfe18d6138c742a332d9776a4dad53937bac171b3c6671a
3
+ size 824176000
qwen2-1_5b-instruct-q4_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:106c176ae807b164f16e2898e8f0267062e3c93c3c18c8267cf9e4ee90766beb
3
+ size 937532800
qwen2-1_5b-instruct-q4_k_m.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f521a15453fd7f820e8467f4a307c99e44f5ab9cc24273d2fe67cd7cb1288f05
3
+ size 986045824
qwen2-1_5b-instruct-q5_0.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:9ad649238cf183d3305a0325b454515982ef5dfc5a7c4de85967e5f493c187aa
3
- size 1259170976
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f1d2a0910c957d707401c6a68c4154371e48d6181dfeca6d548c7f47c79a898c
3
+ size 1101307264
qwen2-1_5b-instruct-q5_k_m.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:35ea2a6d408bd6a5a1d769fd4c49b7afbdcc6ea3a38410993da0ef7726a898d0
3
- size 1285491872
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4448818b560c9f79d79671045d9f475b291851633274cf285edab8785c68eb3e
3
+ size 1125047680
qwen2-1_5b-instruct-q6_k.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:c9f31f1425fe69b572c618d3f9c7748d72700c63d8d7fba9f1581cca8a448808
3
- size 1464176288
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5604cdd7ca828d31a1d9a89b5ff5ab4fcc07dbab11770a7c068d93a90a52af14
3
+ size 1272737152
qwen2-1_5b-instruct-q8_0.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:0a1e8edea2664a89347c572b0fa4af154efaba7ad75a9d17b010020bd22e50eb
3
- size 1894529696
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1fabf28bda17e96824bacc29e43b09ec4ba8a82d190f700cbdd1286586a05311
3
+ size 1646570368