ruClonedGPT_1.4B / README.md
AlexWortega's picture
Update README.md
3c2b8d6
metadata
datasets:
  - IlyaGusev/habr
  - IlyaGusev/rulm
language:
  - ru

cloned transfomer

created with stacking layers, trained on Habr+Rulm

dataset rugpt 760m large AlexWortega/ruClonedGPT_1.4B
xnliru 0.34 0.36
xwinograd 0.65 0.68
danetqa 0.62 0.65
muserc 0.72 0.74
parus 0.584 0.61
rcb 0.417 0.45
rucos 0.21 0.25
russe 0.647 0.66
ruterra 0.654 0.67
rwsd 0.636 0.339