eslamxm commited on
Commit
9137f2a
1 Parent(s): cbff0b6

update model card README.md

Browse files
Files changed (1) hide show
  1. README.md +19 -21
README.md CHANGED
@@ -3,7 +3,7 @@ tags:
3
  - summarization
4
  - generated_from_trainer
5
  datasets:
6
- - xlsum
7
  model-index:
8
  - name: AraT5-base-title-generation-finetuned-ar-xlsum
9
  results: []
@@ -14,14 +14,14 @@ should probably proofread and complete it, then remove this comment. -->
14
 
15
  # AraT5-base-title-generation-finetuned-ar-xlsum
16
 
17
- This model is a fine-tuned version of [UBC-NLP/AraT5-base-title-generation](https://huggingface.co/UBC-NLP/AraT5-base-title-generation) on the xlsum dataset.
18
  It achieves the following results on the evaluation set:
19
- - Loss: 4.3263
20
- - Rouge-1: 32.03
21
- - Rouge-2: 14.67
22
- - Rouge-l: 28.04
23
- - Gen Len: 18.45
24
- - Bertscore: 74.09
25
 
26
  ## Model description
27
 
@@ -41,29 +41,27 @@ More information needed
41
 
42
  The following hyperparameters were used during training:
43
  - learning_rate: 5e-05
44
- - train_batch_size: 6
45
- - eval_batch_size: 6
46
  - seed: 42
47
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
48
  - lr_scheduler_type: linear
49
  - lr_scheduler_warmup_steps: 250
50
- - num_epochs: 10
51
  - label_smoothing_factor: 0.1
52
 
53
  ### Training results
54
 
55
  | Training Loss | Epoch | Step | Validation Loss | Rouge-1 | Rouge-2 | Rouge-l | Gen Len | Bertscore |
56
  |:-------------:|:-----:|:-----:|:---------------:|:-------:|:-------:|:-------:|:-------:|:---------:|
57
- | 5.5156 | 1.0 | 6254 | 4.6874 | 27.18 | 10.66 | 23.51 | 18.72 | 72.39 |
58
- | 5.0589 | 2.0 | 12508 | 4.5374 | 28.93 | 11.87 | 25.02 | 18.69 | 73.11 |
59
- | 4.8629 | 3.0 | 18762 | 4.4512 | 29.31 | 12.22 | 25.51 | 18.79 | 73.2 |
60
- | 4.7327 | 4.0 | 25016 | 4.3989 | 29.8 | 12.73 | 25.95 | 18.72 | 73.42 |
61
- | 4.6317 | 5.0 | 31270 | 4.3729 | 30.23 | 12.9 | 26.37 | 18.71 | 73.57 |
62
- | 4.5557 | 6.0 | 37524 | 4.3497 | 30.46 | 13.14 | 26.57 | 18.76 | 73.6 |
63
- | 4.496 | 7.0 | 43778 | 4.3388 | 30.93 | 13.47 | 26.96 | 18.68 | 73.76 |
64
- | 4.4475 | 8.0 | 50032 | 4.3331 | 30.99 | 13.55 | 27.06 | 18.66 | 73.79 |
65
- | 4.4133 | 9.0 | 56286 | 4.3248 | 31.02 | 13.59 | 27.04 | 18.71 | 73.81 |
66
- | 4.3909 | 10.0 | 62540 | 4.3263 | 31.12 | 13.64 | 27.14 | 18.7 | 73.86 |
67
 
68
 
69
  ### Framework versions
3
  - summarization
4
  - generated_from_trainer
5
  datasets:
6
+ - wiki_lingua
7
  model-index:
8
  - name: AraT5-base-title-generation-finetuned-ar-xlsum
9
  results: []
14
 
15
  # AraT5-base-title-generation-finetuned-ar-xlsum
16
 
17
+ This model is a fine-tuned version of [UBC-NLP/AraT5-base-title-generation](https://huggingface.co/UBC-NLP/AraT5-base-title-generation) on the wiki_lingua dataset.
18
  It achieves the following results on the evaluation set:
19
+ - Loss: 4.8120
20
+ - Rouge-1: 23.29
21
+ - Rouge-2: 8.44
22
+ - Rouge-l: 20.74
23
+ - Gen Len: 18.16
24
+ - Bertscore: 70.88
25
 
26
  ## Model description
27
 
41
 
42
  The following hyperparameters were used during training:
43
  - learning_rate: 5e-05
44
+ - train_batch_size: 4
45
+ - eval_batch_size: 4
46
  - seed: 42
47
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
48
  - lr_scheduler_type: linear
49
  - lr_scheduler_warmup_steps: 250
50
+ - num_epochs: 8
51
  - label_smoothing_factor: 0.1
52
 
53
  ### Training results
54
 
55
  | Training Loss | Epoch | Step | Validation Loss | Rouge-1 | Rouge-2 | Rouge-l | Gen Len | Bertscore |
56
  |:-------------:|:-----:|:-----:|:---------------:|:-------:|:-------:|:-------:|:-------:|:---------:|
57
+ | 6.1002 | 1.0 | 5111 | 5.2917 | 18.95 | 5.84 | 17.01 | 17.9 | 68.69 |
58
+ | 5.4427 | 2.0 | 10222 | 5.0877 | 20.61 | 6.73 | 18.58 | 17.14 | 69.69 |
59
+ | 5.1876 | 3.0 | 15333 | 4.9631 | 21.27 | 7.17 | 19.09 | 17.69 | 69.82 |
60
+ | 5.0256 | 4.0 | 20444 | 4.8984 | 21.7 | 7.53 | 19.55 | 17.56 | 70.18 |
61
+ | 4.9104 | 5.0 | 25555 | 4.8538 | 22.23 | 7.54 | 19.79 | 17.6 | 70.33 |
62
+ | 4.8251 | 6.0 | 30666 | 4.8309 | 22.35 | 7.6 | 19.96 | 17.64 | 70.51 |
63
+ | 4.7666 | 7.0 | 35777 | 4.8168 | 22.45 | 7.81 | 20.15 | 17.47 | 70.61 |
64
+ | 4.7275 | 8.0 | 40888 | 4.8120 | 22.67 | 7.83 | 20.34 | 17.56 | 70.66 |
 
 
65
 
66
 
67
  ### Framework versions