Hugging Face's logo

dranger003
/
c4ai-command-r-plus-iMat.GGUF

Text Generation
GGUF
Inference Endpoints
Model card Files Community
19
dranger003 commited on
Commit
1681123
·
verified ·
1 Parent(s): a1c7e6f

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -29,7 +29,7 @@ Also, I am currently running perplexity on all the quants posted here, and will
29
  | --- | --- | --- |
30
  | <pre>64</pre> | <pre>131072</pre> | <pre>\<BOS_TOKEN\>\<\|START_OF_TURN_TOKEN\|\>\<\|USER_TOKEN\|\>{prompt}\<\|END_OF_TURN_TOKEN\|\>\<\|START_OF_TURN_TOKEN\|\>\<\|CHATBOT_TOKEN\|\>{response}</pre> |
31
 
32
- | Quantization | Model size (GiB) | Perplexity | Delta (FP16) |
33
  | -- | -- | -- | -- |
34
  | IQ1_S | 21.59 | 8.2530 +/- 0.05234 | 88.23% |
35
  | IQ1_M | 23.49 | 7.4267 +/- 0.04646 | 69.39% |
 
29
  | --- | --- | --- |
30
  | <pre>64</pre> | <pre>131072</pre> | <pre>\<BOS_TOKEN\>\<\|START_OF_TURN_TOKEN\|\>\<\|USER_TOKEN\|\>{prompt}\<\|END_OF_TURN_TOKEN\|\>\<\|START_OF_TURN_TOKEN\|\>\<\|CHATBOT_TOKEN\|\>{response}</pre> |
31
 
32
+ | Quantization | Model size (GiB) | Perplexity (wiki.test) | Delta (FP16) |
33
  | -- | -- | -- | -- |
34
  | IQ1_S | 21.59 | 8.2530 +/- 0.05234 | 88.23% |
35
  | IQ1_M | 23.49 | 7.4267 +/- 0.04646 | 69.39% |