huseinzol05
commited on
Commit
•
6ae4a03
1
Parent(s):
26b7166
Update README.md
Browse files
README.md
CHANGED
@@ -7,14 +7,15 @@ metrics:
|
|
7 |
- sacrebleu
|
8 |
---
|
9 |
|
10 |
-
# finetune-paraphrase-t5-
|
11 |
|
12 |
-
Finetuned T5
|
13 |
|
14 |
## Dataset
|
15 |
|
16 |
1. translated PAWS, https://huggingface.co/datasets/mesolitica/translated-PAWS
|
17 |
2. translated MRPC, https://huggingface.co/datasets/mesolitica/translated-MRPC
|
|
|
18 |
|
19 |
## Finetune details
|
20 |
|
@@ -28,23 +29,23 @@ Scripts at https://github.com/huseinzol05/malaya/tree/master/session/paraphrase/
|
|
28 |
|
29 |
## Evaluation
|
30 |
|
31 |
-
Evaluated on MRPC validation set and
|
32 |
|
33 |
```
|
34 |
{'name': 'BLEU',
|
35 |
-
'score':
|
36 |
'_mean': -1.0,
|
37 |
'_ci': -1.0,
|
38 |
-
'_verbose': '
|
39 |
-
'bp': 0.
|
40 |
-
'counts': [
|
41 |
-
'totals': [
|
42 |
-
'sys_len':
|
43 |
-
'ref_len':
|
44 |
-
'precisions': [
|
45 |
-
|
46 |
-
|
47 |
-
|
48 |
-
'prec_str': '
|
49 |
-
'ratio': 0.
|
50 |
```
|
|
|
7 |
- sacrebleu
|
8 |
---
|
9 |
|
10 |
+
# finetune-paraphrase-t5-tiny-standard-bahasa-cased
|
11 |
|
12 |
+
Finetuned T5 tiny on MS paraphrase tasks.
|
13 |
|
14 |
## Dataset
|
15 |
|
16 |
1. translated PAWS, https://huggingface.co/datasets/mesolitica/translated-PAWS
|
17 |
2. translated MRPC, https://huggingface.co/datasets/mesolitica/translated-MRPC
|
18 |
+
3. translated ParaSCI, https://huggingface.co/datasets/mesolitica/translated-paraSCI
|
19 |
|
20 |
## Finetune details
|
21 |
|
|
|
29 |
|
30 |
## Evaluation
|
31 |
|
32 |
+
Evaluated on MRPC validation set and ParaSCI Arxiv test set.
|
33 |
|
34 |
```
|
35 |
{'name': 'BLEU',
|
36 |
+
'score': 37.598729045833316,
|
37 |
'_mean': -1.0,
|
38 |
'_ci': -1.0,
|
39 |
+
'_verbose': '62.6/42.5/33.2/27.0 (BP = 0.957 ratio = 0.958 hyp_len = 96781 ref_len = 101064)',
|
40 |
+
'bp': 0.9567103919247614,
|
41 |
+
'counts': [60539, 38753, 28443, 21680],
|
42 |
+
'totals': [96781, 91237, 85693, 80149],
|
43 |
+
'sys_len': 96781,
|
44 |
+
'ref_len': 101064,
|
45 |
+
'precisions': [62.55256713611143,
|
46 |
+
42.47509234192268,
|
47 |
+
33.19174261608299,
|
48 |
+
27.049620082596164],
|
49 |
+
'prec_str': '62.6/42.5/33.2/27.0',
|
50 |
+
'ratio': 0.9576209134805668}
|
51 |
```
|