Hugging Face's logo

Qwen
/
Qwen1.5-0.5B-Chat-GGUF

Text Generation
GGUF
English
chat
Inference Endpoints
conversational
Model card Files Community
JustinLin610 commited on
Commit
3745a63
·
verified ·
1 Parent(s): 5976f92

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +6 -6
README.md CHANGED
@@ -28,12 +28,12 @@ To demonstrate their model quality, we follow [`llama.cpp`](https://github.com/g
28
 
29
  |Size | fp16 | q8_0 | q6_k | q5_k_m | q5_0 | q4_k_m | q4_0 | q3_k_m | q2_k |
30
  |--------|---------|---------|---------|---------|---------|---------|---------|---------|---------|
31
- |0.5 | 34.20 | 34.22 | 34.31 | 33.80 | 34.02 | 34.27 | 36.74 | 38.25 | 62.14 |
32
- |1.8 | 15.99 | 15.99 | 15.99 | 16.09 | 16.01 | 16.22 | 16.54 | 17.03 | 19.99 |
33
- |4 | 13.20 | 13.21 | 13.28 | 13.24 | 13.27 | 13.61 | 13.44 | 13.67 | 15.65 |
34
- |7 | 14.21 | 14.24 | 14.35 | 14.32 | 14.12 | 14.35 | 14.47 | 15.11 | 16.57 |
35
- |14 | 10.91 | 10.91 | 10.93 | 10.88 | 10.88 | 10.92 | 10.92 | 11.24 | 12.27 |
36
- |72 | 7.97 | 7.99 | 7.99 | 7.99 | 8.01 | 8.00 | 8.01 | 8.06 | 8.63 |
37
 
38
 
39
  ## Model Details
 
28
 
29
  |Size | fp16 | q8_0 | q6_k | q5_k_m | q5_0 | q4_k_m | q4_0 | q3_k_m | q2_k |
30
  |--------|---------|---------|---------|---------|---------|---------|---------|---------|---------|
31
+ |0.5B | 34.20 | 34.22 | 34.31 | 33.80 | 34.02 | 34.27 | 36.74 | 38.25 | 62.14 |
32
+ |1.8B | 15.99 | 15.99 | 15.99 | 16.09 | 16.01 | 16.22 | 16.54 | 17.03 | 19.99 |
33
+ |4B | 13.20 | 13.21 | 13.28 | 13.24 | 13.27 | 13.61 | 13.44 | 13.67 | 15.65 |
34
+ |7B | 14.21 | 14.24 | 14.35 | 14.32 | 14.12 | 14.35 | 14.47 | 15.11 | 16.57 |
35
+ |14B | 10.91 | 10.91 | 10.93 | 10.88 | 10.88 | 10.92 | 10.92 | 11.24 | 12.27 |
36
+ |72B | 7.97 | 7.99 | 7.99 | 7.99 | 8.01 | 8.00 | 8.01 | 8.06 | 8.63 |
37
 
38
 
39
  ## Model Details