huseinzol05 commited on
Commit
eb60d80
1 Parent(s): b447613

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +15 -14
README.md CHANGED
@@ -15,6 +15,7 @@ Finetuned T5 tiny on MS paraphrase tasks.
15
 
16
  1. translated PAWS, https://huggingface.co/datasets/mesolitica/translated-PAWS
17
  2. translated MRPC, https://huggingface.co/datasets/mesolitica/translated-MRPC
 
18
 
19
  ## Finetune details
20
 
@@ -28,23 +29,23 @@ Scripts at https://github.com/huseinzol05/malaya/tree/master/session/paraphrase/
28
 
29
  ## Evaluation
30
 
31
- Evaluated on MRPC validation set and PAWS test set.
32
 
33
  ```
34
  {'name': 'BLEU',
35
- 'score': 61.06784273649806,
36
  '_mean': -1.0,
37
  '_ci': -1.0,
38
- '_verbose': '86.1/68.4/55.8/45.9 (BP = 0.980 ratio = 0.980 hyp_len = 138209 ref_len = 141004)',
39
- 'bp': 0.9799801176769202,
40
- 'counts': [119035, 89737, 69210, 53653],
41
- 'totals': [138209, 131135, 124061, 116987],
42
- 'sys_len': 138209,
43
- 'ref_len': 141004,
44
- 'precisions': [86.1268079502782,
45
- 68.4310062149693,
46
- 55.787072488533866,
47
- 45.86236077512886],
48
- 'prec_str': '86.1/68.4/55.8/45.9',
49
- 'ratio': 0.9801778672945448}
50
  ```
15
 
16
  1. translated PAWS, https://huggingface.co/datasets/mesolitica/translated-PAWS
17
  2. translated MRPC, https://huggingface.co/datasets/mesolitica/translated-MRPC
18
+ 3. translated ParaSCI, https://huggingface.co/datasets/mesolitica/translated-paraSCI
19
 
20
  ## Finetune details
21
 
29
 
30
  ## Evaluation
31
 
32
+ Evaluated on MRPC validation set and ParaSCI Arxiv test set.
33
 
34
  ```
35
  {'name': 'BLEU',
36
+ 'score': 36.92696648298233,
37
  '_mean': -1.0,
38
  '_ci': -1.0,
39
+ '_verbose': '62.5/42.3/33.0/26.9 (BP = 0.943 ratio = 0.945 hyp_len = 95496 ref_len = 101064)',
40
+ 'bp': 0.9433611337299734,
41
+ 'counts': [59650, 38055, 27875, 21217],
42
+ 'totals': [95496, 89952, 84408, 78864],
43
+ 'sys_len': 95496,
44
+ 'ref_len': 101064,
45
+ 'precisions': [62.46334925023038,
46
+ 42.30589647812167,
47
+ 33.02412093640413,
48
+ 26.90327652667884],
49
+ 'prec_str': '62.5/42.3/33.0/26.9',
50
+ 'ratio': 0.944906198052719}
51
  ```