---
language:
- ru
widget:
- text: "Бог, это "
metrics:
- loss: 3.3
- perplexity: 25.7528
---

Start from sberbank-ai/rugpt3small_based_on_gpt2 and finetuning on Biblie & preaching (russian).

On this moment - only 1 epoch, 1650 seq length

on progress...