long-t5-tglobal-small-dutch-cnn
A Long-T5 tglobal small model pre-trained from scratch on cleaned Dutch 🇳🇱🇧🇪 mC4 and cleaned English 🇬🇧 C4, and fine-tuned on CNN news summarization in Dutch.
See https://wandb.ai/yepster/long-t5-tglobal-small-dutch-cnn/runs/15an8yyr?workspace=user-yepster
- Downloads last month
- 21
Datasets used to train yhavinga/long-t5-tglobal-small-dutch-cnn
Evaluation results
- ROUGE-1 on ml6team/cnn_dailymail_nltest set verified36.416
- ROUGE-2 on ml6team/cnn_dailymail_nltest set verified14.669
- ROUGE-L on ml6team/cnn_dailymail_nltest set verified24.858
- ROUGE-LSUM on ml6team/cnn_dailymail_nltest set verified33.156
- loss on ml6team/cnn_dailymail_nltest set verified1.933
- gen_len on ml6team/cnn_dailymail_nltest set verified119.771