README - long-t5-tglobal-base-16384-booksum-V11-big_patent-V2
- this README was added because there wasn't one
- created 2022-07-31_12-14-50
about
An experiment testing some transfer learning with pszemraj/long-t5-tglobal-base-16384-book-summary to evaluate the ability to learn some technical documentation through the big_patent dataset on huggingface.
This checkpoint has been trained on dataset subsection y of big_patent for approx 400 steps of functional batch size 128.
- Downloads last month
- 6
This model does not have enough activity to be deployed to Inference API (serverless) yet.
Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated)
instead.
Datasets used to train pszemraj/long-t5-tglobal-base-16384-booksum-V11-big_patent-V2
Space using pszemraj/long-t5-tglobal-base-16384-booksum-V11-big_patent-V2 1
Evaluation results
- ROUGE-1 on kmfoda/booksumtest set verified23.144
- ROUGE-2 on kmfoda/booksumtest set verified3.239
- ROUGE-L on kmfoda/booksumtest set verified12.704
- ROUGE-LSUM on kmfoda/booksumtest set verified19.810
- loss on kmfoda/booksumtest set verified2.766
- gen_len on kmfoda/booksumtest set verified63.449
- ROUGE-1 on samsumtest set verified26.803
- ROUGE-2 on samsumtest set verified6.066
- ROUGE-L on samsumtest set verified20.010
- ROUGE-LSUM on samsumtest set verified21.912