| datasets: | |
| - IlyaGusev/habr | |
| - IlyaGusev/rulm | |
| language: | |
| - ru | |
| # cloned transfomer | |
| created with stacking layers, trained on Habr+Rulm | |
| | dataset |rugpt 760m large|AlexWortega/ruClonedGPT_1.4B| | |
| | --------- | -------- |------ | | |
| | xnliru | 0.34 |0.36 | | |
| | xwinograd | 0.65 |0.68 | | |
| | danetqa | 0.62 |0.65 | | |
| | muserc | 0.72 |0.74 | | |
| | parus | 0.584 |0.61 | | |
| | rcb | 0.417 |0.45 | | |
| | rucos | 0.21 |0.25 | | |
| | russe | 0.647 |0.66 | | |
| | ruterra | 0.654 |0.67 | | |
| | rwsd | 0.636 | 0.339 | |