Upload README.md with huggingface_hub
Browse files
README.md
CHANGED
@@ -20,12 +20,12 @@ tags:
|
|
20 |
|
21 |
This is a 7.0bpw EXL2 quant of [CohereForAI/c4ai-command-r-v01](https://huggingface.co/CohereForAI/c4ai-command-r-v01)
|
22 |
|
23 |
-
Details about the model
|
24 |
|
25 |
|
26 |
## EXL2 Version
|
27 |
|
28 |
-
These quants were made with exllamav2 version 0.0.18. Quants made on this version of EXL2 may not
|
29 |
|
30 |
If you have problems loading these models, please update Text Generation WebUI to the latest version.
|
31 |
|
@@ -71,7 +71,6 @@ Here are the EQ Bench scores for the EXL2 quants using Alpaca, ChatML, Command-R
|
|
71 |
|
72 |
| Quant Size | Instruct Template | Score |
|
73 |
|------------|-------------------|-------|
|
74 |
-
| Run ID | Prompt Format | Benchmark Score |
|
75 |
| 8.0 | Alpaca | 56.67 |
|
76 |
| 8.0 | ChatML | 47.28 |
|
77 |
| 8.0 | Command-R | 58.46 |
|
@@ -146,8 +145,9 @@ Here are the EQ Bench scores for the EXL2 quants using Alpaca, ChatML, Command-R
|
|
146 |
|
147 |
### Command-R-Plus Template
|
148 |
|
149 |
-
This is the Command-R-Plus template yaml that was used in EQ bench. It adds BOS_TOKEN into the starter prompt.
|
150 |
|
|
|
151 |
```yaml
|
152 |
instruction_template: |-
|
153 |
{%- if messages[0]['role'] == 'system' -%}
|
|
|
20 |
|
21 |
This is a 7.0bpw EXL2 quant of [CohereForAI/c4ai-command-r-v01](https://huggingface.co/CohereForAI/c4ai-command-r-v01)
|
22 |
|
23 |
+
Details about the model can be found at the above model page.
|
24 |
|
25 |
|
26 |
## EXL2 Version
|
27 |
|
28 |
+
These quants were made with exllamav2 version 0.0.18. Quants made on this version of EXL2 may not work on older versions of the exllamav2 library.
|
29 |
|
30 |
If you have problems loading these models, please update Text Generation WebUI to the latest version.
|
31 |
|
|
|
71 |
|
72 |
| Quant Size | Instruct Template | Score |
|
73 |
|------------|-------------------|-------|
|
|
|
74 |
| 8.0 | Alpaca | 56.67 |
|
75 |
| 8.0 | ChatML | 47.28 |
|
76 |
| 8.0 | Command-R | 58.46 |
|
|
|
145 |
|
146 |
### Command-R-Plus Template
|
147 |
|
148 |
+
This is the Command-R-Plus template yaml that was used in EQ bench(which uses Text Generation Web UI yaml templates). It adds BOS_TOKEN into the starter prompt.
|
149 |
|
150 |
+
_text-generation-webui/instruction-templates/Command-R-Plus.yaml_:
|
151 |
```yaml
|
152 |
instruction_template: |-
|
153 |
{%- if messages[0]['role'] == 'system' -%}
|