Hugging Face's logo

Qwen
/
Qwen2-0.5B-Instruct-GGUF

Text Generation
GGUF
English
instruct
chat
Inference Endpoints
conversational
Model card Files Community
2
JustinLin610 commited on
Commit
8f703d1
·
verified ·
1 Parent(s): ce356cb

Upload folder using huggingface_hub

Browse files
Files changed (9) hide show
  1. qwen2-0_5b-instruct-fp16.gguf +2 -2
  2. qwen2-0_5b-instruct-q2_k.gguf +3 -0
  3. qwen2-0_5b-instruct-q3_k_m.gguf +3 -0
  4. qwen2-0_5b-instruct-q4_0.gguf +2 -2
  5. qwen2-0_5b-instruct-q4_k_m.gguf +2 -2
  6. qwen2-0_5b-instruct-q5_0.gguf +2 -2
  7. qwen2-0_5b-instruct-q5_k_m.gguf +2 -2
  8. qwen2-0_5b-instruct-q6_k.gguf +2 -2
  9. qwen2-0_5b-instruct-q8_0.gguf +2 -2
qwen2-0_5b-instruct-fp16.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:bfcf673a36ac38b99fd032f5172d1bfa7f427ea6a4c464db0cc8d99045d040ea
3
- size 1266423264
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5cee958765bfd13139d671338bfbe24cae8b631608cd720051bba426302affc1
3
+ size 994153920
qwen2-0_5b-instruct-q2_k.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:12f42f2362052e4811b25bf251185be0a753ff382d83460c15064696df52f206
3
+ size 338604736
qwen2-0_5b-instruct-q3_k_m.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fd2d897ea4af94d2b4fdbd09be67dc079ebd02162c80fa54cdfb2b278f4e1e92
3
+ size 355463872
qwen2-0_5b-instruct-q4_0.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:2d9d7837ffd63eceee4126f5e797011f5d4ff7cc2905293fe66a93060c0e3745
3
- size 428727776
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:aca679832ded61145239ce7f5c5ebddb1c57ada786c9c23733899c3888e0596f
3
+ size 352969408
qwen2-0_5b-instruct-q4_k_m.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:16e71e138b457cf8db68702f9fb661b81ec9656fe76e2d17bb8264bd4ee65b2c
3
- size 491397600
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f0a42bb979ca62b5e61f3bf924ab4b6a40aa091825ee7dcb4039949980ab81a8
3
+ size 397805248
qwen2-0_5b-instruct-q5_0.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:2165adaee902bb8142445867e03aa3e1862b863587c06ede4556ef425cf2cc58
3
- size 490472928
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3629e7b5f99609a4d28d07d3932fde45e03b393979adcf5249270d985aba8099
3
+ size 397697728
qwen2-0_5b-instruct-q5_k_m.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:16654d862b4b19f4f92ba14e11f056d0220400f59ee74e7a204cf0bf17e64d32
3
- size 522184160
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:06ab0dc113ec3004e17cc0b2ec28ea953c2f02505c17f35b24f0b594a455d500
3
+ size 420083392
qwen2-0_5b-instruct-q6_k.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:bac3397645e4d97a19bc26dc07e376d3be21973674bd8b598a8c2cc8980f4b6a
3
- size 650376672
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:251317191d3338dfbc43b0a8c06a789b302cf875c8a815507f1c9f06cf5e1766
3
+ size 505733824
qwen2-0_5b-instruct-q8_0.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:703ba70a4459d597ad855837362e6364ae10be4aefd0e01496df2022575550b2
3
- size 675708384
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:834f4115ad5a836c9f17716b1577290fda96de3deb881ba45a4d5476fd202e96
3
+ size 531065536