Dracones commited on
Commit
6b8b3f0
1 Parent(s): 0841e78

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +8 -1
README.md CHANGED
@@ -51,12 +51,19 @@ Below are the perplexity scores for the EXL2 models. A lower score is better.
51
  | 3.0 | 5.2050 | [turboderp](https://huggingface.co/turboderp/command-r-plus-103B-exl2) |
52
  | 2.5 | 5.6681 | [turboderp](https://huggingface.co/turboderp/command-r-plus-103B-exl2) |
53
 
 
54
 
55
  ## EQ Bench
56
 
57
  Here are the EQ Bench scores for the EXL2 quants using Alpaca, ChatML, Command-R and Command-R-Plus prompt templates. A higher score is better.
58
 
59
- _TODO_
 
 
 
 
 
 
60
 
61
  ### Command-R-Plus Template
62
 
 
51
  | 3.0 | 5.2050 | [turboderp](https://huggingface.co/turboderp/command-r-plus-103B-exl2) |
52
  | 2.5 | 5.6681 | [turboderp](https://huggingface.co/turboderp/command-r-plus-103B-exl2) |
53
 
54
+ _TODO:_ Dracones quant perplexity scores being worked on.
55
 
56
  ## EQ Bench
57
 
58
  Here are the EQ Bench scores for the EXL2 quants using Alpaca, ChatML, Command-R and Command-R-Plus prompt templates. A higher score is better.
59
 
60
+ | Quant Size | Alpaca | ChatML | Command-R | Command-R-Plus |
61
+ |------------|--------|--------|--------|--------|
62
+ | 6.0 | 70.77 | 62.58 | 75.81 | 74.95 |
63
+ | 5.0 | 69.51 | 63.94 | 74.92 | 75.28 |
64
+
65
+
66
+ _TODO:_ EQ Bench scores being worked on.
67
 
68
  ### Command-R-Plus Template
69