|
--- |
|
language: |
|
- ms |
|
tags: |
|
- paraphrase |
|
metrics: |
|
- sacrebleu |
|
--- |
|
|
|
# finetune-paraphrase-t5-base-standard-bahasa-cased |
|
|
|
Finetuned T5 base on MS paraphrase tasks. |
|
|
|
## Dataset |
|
|
|
1. translated PAWS, https://huggingface.co/datasets/mesolitica/translated-PAWS |
|
2. translated MRPC, https://huggingface.co/datasets/mesolitica/translated-MRPC |
|
3. translated ParaSCI, https://huggingface.co/datasets/mesolitica/translated-paraSCI |
|
|
|
## Finetune details |
|
|
|
1. Finetune using single RTX 3090 Ti. |
|
|
|
Scripts at https://github.com/huseinzol05/malaya/tree/master/session/paraphrase/hf-t5 |
|
|
|
## Supported prefix |
|
|
|
1. `parafrasa: {string}`, for MS paraphrase. |
|
|
|
## Evaluation |
|
|
|
Evaluated on MRPC validation set and ParaSCI Arxiv test set. |
|
|
|
``` |
|
{'name': 'BLEU', |
|
'score': 35.95965899952292, |
|
'_mean': -1.0, |
|
'_ci': -1.0, |
|
'_verbose': '61.7/41.3/32.0/25.8 (BP = 0.944 ratio = 0.946 hyp_len = 95593 ref_len = 101064)', |
|
'bp': 0.9443747373110852, |
|
'counts': [59014, 37157, 27016, 20383], |
|
'totals': [95593, 90049, 84505, 78961], |
|
'sys_len': 95593, |
|
'ref_len': 101064, |
|
'precisions': [61.73464584226878, |
|
41.263090095392506, |
|
31.969705934560086, |
|
25.81400944770203], |
|
'prec_str': '61.7/41.3/32.0/25.8', |
|
'ratio': 0.9458659859099184} |
|
``` |
