gpt2_priest_ru / README.md
Nehc's picture
Create README.md
a4c0911
metadata
language:
  - ru
widget:
  - text: 'Бог, это '
metrics:
  - loss: 3.3
  - perplexity: 25.7528

Start from sberbank-ai/rugpt3small_based_on_gpt2 and finetuning on Biblie & preaching (russian).

On this moment - only 1 epoch, 1650 seq length

on progress...