Update README.md
Browse files
README.md
CHANGED
@@ -24,7 +24,8 @@ You'll notice that these quantizations are slightly larger compared to others, b
|
|
24 |
|
25 |
```./perplexity -m dolphin2m.gguf -f wiki.test.raw -ngl 34```
|
26 |
|
27 |
-
```
|
|
|
28 |
Final estimate: PPL = 7.8476 +/- 0.35984 THIS IS BASELINE
|
29 |
|
30 |
dolphin1bit.gguf perplexity - [1]59477.7292,[2]50746.4580,[3]53932.3131,[4]55797.8433,[5]45995.5032,[6]46595.4234,[7]45130.6779,[8]40769.8593,[9]41322.7842,[10]50644.7393,[11]50676.5808,[12]51939.5094,
|
|
|
24 |
|
25 |
```./perplexity -m dolphin2m.gguf -f wiki.test.raw -ngl 34```
|
26 |
|
27 |
+
```bash
|
28 |
+
dolphinf16.gguf perplexity - [1]4.3052,[2]4.8421,[3]5.7401,[4]6.6554,[5]6.6552,[6]6.6580,[7]6.9198,[8]7.0918,[9]7.2503,[10]7.5712,[11]7.8367,[12]7.8476,
|
29 |
Final estimate: PPL = 7.8476 +/- 0.35984 THIS IS BASELINE
|
30 |
|
31 |
dolphin1bit.gguf perplexity - [1]59477.7292,[2]50746.4580,[3]53932.3131,[4]55797.8433,[5]45995.5032,[6]46595.4234,[7]45130.6779,[8]40769.8593,[9]41322.7842,[10]50644.7393,[11]50676.5808,[12]51939.5094,
|