File size: 400 Bytes
32741ef
 
 
 
 
 
 
 
 
 
955a0de
476aa6f
32741ef
 
4f9607c
 
 
43a459f
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
---
license: apache-2.0
datasets:
- IlyaGusev/habr
language:
- ru
- en
library_name: transformers
---

# Mistral Based russian language model, pretrained on 400m tokens on 3 epochs over original mistral

|   dataset |AlexWortega/Vikhr-7b-0.1|mistralai/Mistral-7B-v0.1|
| --------- | -------- |------  |
| mmlu_ru    | 0.59   | 0.49  |
| xwinograd |   0.7443 | 0.681   |
| xnli | 0.3980  | 0.3691  |