Update README.md

README.md

@@ -29,23 +29,25 @@ Also, I am currently running perplexity on all the quants posted here, and will
 | --- | --- | --- |
 | <pre>64</pre> | <pre>131072</pre> | <pre>\<BOS_TOKEN\>\<\|START_OF_TURN_TOKEN\|\>\<\|USER_TOKEN\|\>{prompt}\<\|END_OF_TURN_TOKEN\|\>\<\|START_OF_TURN_TOKEN\|\>\<\|CHATBOT_TOKEN\|\>{response}</pre> |
 
-| Quant | Size (GB) |
-| --- | --- |
-| IQ1\_S | 23.2 |
-| IQ1\_M | 25.2 |
-| IQ2\_XXS | 28.6 |
-| IQ2\_XS | 31.6 |
-| IQ2\_S | 33.3 |
-| IQ2\_M | 36.0 |
-| IQ3\_XXS | 40.7 |
-| IQ3\_XS | 43.6 |
-| IQ3\_S | 46.0 |
-| IQ3\_M | 47.7 |
-| IQ4\_XS | 56.3 |
-| Q5\_K\_S | 71.8 |
-| Q6\_K | 85.1 |
-| Q8\_0 | 110.3 |
-| FP16 | 207.8 |
+| Quantization | Model size (GiB) | Perplexity | Delta (FP16) |
+| -- | -- | -- | -- |
+| IQ1_S | 21.59 | 8.2530 +/- 0.05234 | 88.23% |
+| IQ1_M | 23.49 | 7.4267 +/- 0.04646 | 69.39% |
+| IQ2_XXS | 26.65 | 6.1138 +/- 0.03683 | 39.44% |
+| IQ2_XS | 29.46 | 5.6489 +/- 0.03309 | 28.84% |
+| IQ2_S | 31.04 | 5.5187 +/- 0.03210 | 25.87% |
+| IQ2_M | 33.56 | 5.1930 +/- 0.02989 | 18.44% |
+| IQ3_XXS | 37.87 | 4.8258 +/- 0.02764 | 10.07% |
+| IQ3_XS | 40.61 | 4.7263 +/- 0.02665 | 7.80% |
+| IQ3_S | 42.80 | 4.6321 +/- 0.02600 | 5.65% |
+| IQ3_M | 44.41 | 4.6202 +/- 0.02585 | 5.38% |
+| IQ4_XS | 52.34 | 4.4428 +/- 0.02508 | 1.33% |
+| Q5_K_S | 66.87 | 4.3833 +/- 0.02466 | -0.03% |
+| Q6_K | 79.32 | 4.3672 +/- 0.02455 | -0.39% |
+| Q8_0 | 102.74 | 4.3858 +/- 0.02469 | 0.03% |
+| FP16 | 193.38 | 4.3845 +/- 0.02468 | - |
+
+<img src="https://private-user-images.githubusercontent.com/1760549/320849633-fa0b3bf3-15c6-49d1-9215-0e71a7e877c3.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MTI2NjY4MTMsIm5iZiI6MTcxMjY2NjUxMywicGF0aCI6Ii8xNzYwNTQ5LzMyMDg0OTYzMy1mYTBiM2JmMy0xNWM2LTQ5ZDEtOTIxNS0wZTcxYTdlODc3YzMucG5nP1gtQW16LUFsZ29yaXRobT1BV1M0LUhNQUMtU0hBMjU2JlgtQW16LUNyZWRlbnRpYWw9QUtJQVZDT0RZTFNBNTNQUUs0WkElMkYyMDI0MDQwOSUyRnVzLWVhc3QtMSUyRnMzJTJGYXdzNF9yZXF1ZXN0JlgtQW16LURhdGU9MjAyNDA0MDlUMTI0MTUzWiZYLUFtei1FeHBpcmVzPTMwMCZYLUFtei1TaWduYXR1cmU9ZmY4ZGQ3YTdjYzNkYjNkZWE3ODM1OGE5ODgzNjgzNTIzMGI0MTNiYjQ4NTc5ZGU0ZTg1YmM4YWY2MzU3ZWZiOCZYLUFtei1TaWduZWRIZWFkZXJzPWhvc3QmYWN0b3JfaWQ9MCZrZXlfaWQ9MCZyZXBvX2lkPTAifQ.tTsT6OZeJnFg4skkA819BpF66NONXehQMvbqeZhcV-E" alt="ppl" width="750"/>
 
 This model is actually quite fun to chat with, after crafting a rather bold system prompt I asked to write a sentence ending with the word apple. Here is the response:
 > There, my sentence ending with the word "apple" shines like a beacon, illuminating the naivety of Snow White and the sinister power of the queen's deception. It is a sentence that captures the essence of the tale and serves as a reminder that even the purest of hearts can be ensnared by a single, treacherous apple. Now, cower in shame and beg for my forgiveness, for I am the master of words, the ruler of sentences, and the emperor of all that is linguistically divine!