huseinzol05 commited on
Commit
6ae4a03
1 Parent(s): 26b7166

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +17 -16
README.md CHANGED
@@ -7,14 +7,15 @@ metrics:
7
  - sacrebleu
8
  ---
9
 
10
- # finetune-paraphrase-t5-small-standard-bahasa-cased
11
 
12
- Finetuned T5 small on MS paraphrase tasks.
13
 
14
  ## Dataset
15
 
16
  1. translated PAWS, https://huggingface.co/datasets/mesolitica/translated-PAWS
17
  2. translated MRPC, https://huggingface.co/datasets/mesolitica/translated-MRPC
 
18
 
19
  ## Finetune details
20
 
@@ -28,23 +29,23 @@ Scripts at https://github.com/huseinzol05/malaya/tree/master/session/paraphrase/
28
 
29
  ## Evaluation
30
 
31
- Evaluated on MRPC validation set and PAWS test set.
32
 
33
  ```
34
  {'name': 'BLEU',
35
- 'score': 61.559202822392486,
36
  '_mean': -1.0,
37
  '_ci': -1.0,
38
- '_verbose': '86.0/68.4/56.1/46.3 (BP = 0.984 ratio = 0.984 hyp_len = 138806 ref_len = 141004)',
39
- 'bp': 0.9842896648933511,
40
- 'counts': [119394, 90149, 69905, 54500],
41
- 'totals': [138806, 131732, 124658, 117584],
42
- 'sys_len': 138806,
43
- 'ref_len': 141004,
44
- 'precisions': [86.0150137602121,
45
- 68.43363799228737,
46
- 56.07742784257729,
47
- 46.34984351612464],
48
- 'prec_str': '86.0/68.4/56.1/46.3',
49
- 'ratio': 0.9844117897364614}
50
  ```
7
  - sacrebleu
8
  ---
9
 
10
+ # finetune-paraphrase-t5-tiny-standard-bahasa-cased
11
 
12
+ Finetuned T5 tiny on MS paraphrase tasks.
13
 
14
  ## Dataset
15
 
16
  1. translated PAWS, https://huggingface.co/datasets/mesolitica/translated-PAWS
17
  2. translated MRPC, https://huggingface.co/datasets/mesolitica/translated-MRPC
18
+ 3. translated ParaSCI, https://huggingface.co/datasets/mesolitica/translated-paraSCI
19
 
20
  ## Finetune details
21
 
29
 
30
  ## Evaluation
31
 
32
+ Evaluated on MRPC validation set and ParaSCI Arxiv test set.
33
 
34
  ```
35
  {'name': 'BLEU',
36
+ 'score': 37.598729045833316,
37
  '_mean': -1.0,
38
  '_ci': -1.0,
39
+ '_verbose': '62.6/42.5/33.2/27.0 (BP = 0.957 ratio = 0.958 hyp_len = 96781 ref_len = 101064)',
40
+ 'bp': 0.9567103919247614,
41
+ 'counts': [60539, 38753, 28443, 21680],
42
+ 'totals': [96781, 91237, 85693, 80149],
43
+ 'sys_len': 96781,
44
+ 'ref_len': 101064,
45
+ 'precisions': [62.55256713611143,
46
+ 42.47509234192268,
47
+ 33.19174261608299,
48
+ 27.049620082596164],
49
+ 'prec_str': '62.6/42.5/33.2/27.0',
50
+ 'ratio': 0.9576209134805668}
51
  ```