- Downloads last month
- 15
Dataset used to train pszemraj/long-t5-tglobal-base-16384-booksum-V12
Evaluation results
- ROUGE-1 on samsumtest set verified30.003
- ROUGE-2 on samsumtest set verified7.267
- ROUGE-L on samsumtest set verified21.878
- ROUGE-LSUM on samsumtest set verified26.437
- loss on samsumtest set verified2.638
- gen_len on samsumtest set verified54.236
- ROUGE-1 on launch/gov_reporttest set verified37.054
- ROUGE-2 on launch/gov_reporttest set verified8.151
- ROUGE-L on launch/gov_reporttest set verified17.665
- ROUGE-LSUM on launch/gov_reporttest set verified33.428
- loss on launch/gov_reporttest set verified2.605
- gen_len on launch/gov_reporttest set verified201.595
- ROUGE-1 on kmfoda/booksumtest set verified36.142
- ROUGE-2 on kmfoda/booksumtest set verified5.634
- ROUGE-L on kmfoda/booksumtest set verified16.375
- ROUGE-LSUM on kmfoda/booksumtest set verified33.066
- loss on kmfoda/booksumtest set verified2.454
- gen_len on kmfoda/booksumtest set verified239.418
- ROUGE-1 on big_patenttest set verified35.615
- ROUGE-2 on big_patenttest set verified8.262
- ROUGE-L on big_patenttest set verified19.988
- ROUGE-LSUM on big_patenttest set verified30.180
- loss on big_patenttest set verified2.811
- gen_len on big_patenttest set verified170.348