| ### google/flan-t5-base finetuned on xsum dataset | |
| #### train args<br> | |
| max_input_length: 512<br> | |
| max_tgt_length: 128<br> | |
| epoch: 3<br> | |
| optimizer: AdamW<br> | |
| lr: 2e-5<br> | |
| weight_decay: 1e-3<br> | |
| fp16: False<br> | |
| prefix: "summarize: "<br> | |
| #### performance<br> | |
| eval_rouge1: 38.6648<br> | |
| eval_rouge2: 15.5661<br> | |
| eval_rougeL: 30.6158<br> | |
| #### usage<br> | |
| from transformers import AutoTokenizer, AutoModelForSeq2SeqLM<br> | |