add mmlu and ru benchs

README.md

@@ -33,18 +33,26 @@ Quantized with [OmniQuant](https://github.com/OpenGVLab/OmniQuant).
 
 ### Accuracy on English Benchmarks, % (↑)
 
-|               | piqa | arc_easy | arc_challenge | boolq | hellaswag | winogrande |
-| ------------- | ---- | -------- | ------------- | ----- | --------- | ---------- |
-| FP            | 81,5 | 86,2     | 61,9          | 87,4  | 63,7      | 75,8       |
-| **Quantized** | 80,7 | 85,8     | 61,4          | 87,0  | 62,7      | 73,0       |
+|               | piqa | arc_easy | arc_challenge | boolq | hellaswag | winogrande | mmlu_humanities | mmlu_social_sciences | mmlu_stem | mmlu_other |
+| ------------- | ---- | -------- | ------------- | ----- | --------- | ---------- | --------------- | -------------------- | --------- | ---------- |
+| FP            | 81,5 | 86,2     | 61,9          | 87,4  | 63,7      | 75,8       | 78,7            | 84,4                 | 71,1      | 80,2       |
+| **Quantized** | 80,7 | 85,8     | 61,4          | 87,0  | 62,7      | 73,0       | 75,5            | 81,0                 | 68,6      | 77,9       |
+
+
+### Accuracy on Russian Benchmarks, % (↑)
+
+|               | danetqa | terra | rwsd | muserc | rucos | lidirus | parus | rcb  | russe | rucola |
+| ------------- | ------- | ----- | ---- | ------ | ----- | ------- | ----- | ---- | ----- | ------ |
+| FP            | 88,9    | 88,6  | 75,5 | 81,8   | 82,4  | 70,7    | 77,0  | 35,0 | 63,1  | 34,7   |
+| **Quantized** | 86,6    | 81,8  | 71,6 | 75,6   | 69,5  | 60,3    | 64,0  | 26,8 | 63,1  | 32,5   |
 
 
 ### Summary
 
-|               | Avg acc diff on Eng, % (↑) | Occupied disk space, % (↓) |
-| ------------- | -------------------------- | -------------------------- |
-| FP            | 0                          | 100                        |
-| **Quantized** | \-1,0                      | 28,2                       |
+|               | Avg acc diff on Eng, % (↑) | Avg acc diff on Rus, % (↑) | Occupied disk space, % (↓) |
+| ------------- | -------------------------- | -------------------------- | -------------------------- |
+| FP            | 0                          | 0                          | 100                        |
+| **Quantized** | \-1,7                      | \-6,6                      | 28,2                       |
 
 
 ## Examples