long-t5-tglobal-small-dutch-cnn
A Long-T5 tglobal small model pre-trained from scratch on cleaned Dutch 🇳🇱🇧🇪 mC4 and cleaned English 🇬🇧 C4, and fine-tuned on CNN news summarization in Dutch.
See https://wandb.ai/yepster/long-t5-tglobal-small-dutch-cnn/runs/15an8yyr?workspace=user-yepster
- Downloads last month
- 19
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social
visibility and check back later, or deploy to Inference Endpoints (dedicated)
instead.
Datasets used to train yhavinga/long-t5-tglobal-small-dutch-cnn
Evaluation results
- ROUGE-1 on ml6team/cnn_dailymail_nltest set verified36.416
- ROUGE-2 on ml6team/cnn_dailymail_nltest set verified14.669
- ROUGE-L on ml6team/cnn_dailymail_nltest set verified24.858
- ROUGE-LSUM on ml6team/cnn_dailymail_nltest set verified33.156
- loss on ml6team/cnn_dailymail_nltest set verified1.933
- gen_len on ml6team/cnn_dailymail_nltest set verified119.771