VaniLara commited on
Commit
4333f0c
·
verified ·
1 Parent(s): 64bb009

Model save

Browse files
Files changed (1) hide show
  1. README.md +24 -24
README.md CHANGED
@@ -18,10 +18,10 @@ should probably proofread and complete it, then remove this comment. -->
18
 
19
  This model is a fine-tuned version of [vgaraujov/bart-base-spanish](https://huggingface.co/vgaraujov/bart-base-spanish) on an unknown dataset.
20
  It achieves the following results on the evaluation set:
21
- - Loss: 0.0126
22
- - Bleu: 82.8676
23
- - Rouge: {'rouge1': 0.9437468226218229, 'rouge2': 0.8812697966521498, 'rougeL': 0.9395239597433869, 'rougeLsum': 0.939101609432879}
24
- - Ter: 8.4337
25
 
26
  ## Model description
27
 
@@ -53,26 +53,26 @@ The following hyperparameters were used during training:
53
 
54
  | Training Loss | Epoch | Step | Validation Loss | Bleu | Rouge | Ter |
55
  |:-------------:|:-----:|:----:|:---------------:|:-------:|:---------------------------------------------------------------------------------------------------------------------------:|:-------:|
56
- | 0.0352 | 1.0 | 225 | 0.0224 | 74.0878 | {'rouge1': 0.8854400386908132, 'rouge2': 0.7726343101343103, 'rougeL': 0.8736830578548853, 'rougeLsum': 0.8744477205800738} | 15.9407 |
57
- | 0.0196 | 2.0 | 450 | 0.0159 | 79.6691 | {'rouge1': 0.9234599418183012, 'rouge2': 0.8368382374705905, 'rougeL': 0.9192203787497907, 'rougeLsum': 0.9185888742607009} | 10.7507 |
58
- | 0.0112 | 3.0 | 675 | 0.0138 | 81.3904 | {'rouge1': 0.9371518247547659, 'rouge2': 0.8625052355052354, 'rougeL': 0.9321157099980629, 'rougeLsum': 0.93086695929343} | 9.4532 |
59
- | 0.0112 | 4.0 | 900 | 0.0125 | 81.3953 | {'rouge1': 0.935352461264226, 'rouge2': 0.8614905187405189, 'rougeL': 0.9304695337342398, 'rougeLsum': 0.92971737984238} | 9.0825 |
60
- | 0.0102 | 5.0 | 1125 | 0.0119 | 82.4227 | {'rouge1': 0.9450379695124278, 'rouge2': 0.8768333050391874, 'rougeL': 0.9407550114144541, 'rougeLsum': 0.9398356791127689} | 8.1557 |
61
- | 0.0055 | 6.0 | 1350 | 0.0117 | 81.7183 | {'rouge1': 0.9425647720013044, 'rouge2': 0.8721127260539027, 'rougeL': 0.9388823089964731, 'rougeLsum': 0.9378313199528371} | 8.2484 |
62
- | 0.0057 | 7.0 | 1575 | 0.0116 | 82.3002 | {'rouge1': 0.9473650402744831, 'rouge2': 0.8730025138260433, 'rougeL': 0.9436920319962114, 'rougeLsum': 0.9428945246360106} | 8.2484 |
63
- | 0.0061 | 8.0 | 1800 | 0.0124 | 83.8358 | {'rouge1': 0.9478620693891592, 'rouge2': 0.8797453913189207, 'rougeL': 0.9426933990502102, 'rougeLsum': 0.9426768525592056} | 7.7850 |
64
- | 0.0059 | 9.0 | 2025 | 0.0122 | 82.1350 | {'rouge1': 0.9426194010667697, 'rouge2': 0.8694679742915039, 'rougeL': 0.9378532039855569, 'rougeLsum': 0.9374395752166648} | 9.1752 |
65
- | 0.0049 | 10.0 | 2250 | 0.0120 | 81.1412 | {'rouge1': 0.9429826236714781, 'rouge2': 0.8710716021451317, 'rougeL': 0.9382917900812637, 'rougeLsum': 0.9375637288408187} | 8.8971 |
66
- | 0.0035 | 11.0 | 2475 | 0.0120 | 81.9737 | {'rouge1': 0.9475511025781922, 'rouge2': 0.8855785510785512, 'rougeL': 0.9443108339029394, 'rougeLsum': 0.9436322714093611} | 8.1557 |
67
- | 0.0034 | 12.0 | 2700 | 0.0118 | 83.0094 | {'rouge1': 0.9407159654930555, 'rouge2': 0.8766842395077692, 'rougeL': 0.9358921054865327, 'rougeLsum': 0.9348008267102692} | 8.6191 |
68
- | 0.0033 | 13.0 | 2925 | 0.0122 | 80.6100 | {'rouge1': 0.9358671377641969, 'rouge2': 0.8644661112308173, 'rougeL': 0.9305132606471618, 'rougeLsum': 0.9297473792547324} | 9.1752 |
69
- | 0.0026 | 14.0 | 3150 | 0.0121 | 82.3802 | {'rouge1': 0.9378005525176578, 'rouge2': 0.8672443259355025, 'rougeL': 0.9329334678049847, 'rougeLsum': 0.9321404927202139} | 8.8971 |
70
- | 0.0036 | 15.0 | 3375 | 0.0124 | 81.0244 | {'rouge1': 0.9357164094505428, 'rouge2': 0.8664948586272117, 'rougeL': 0.9308478566067575, 'rougeLsum': 0.9302164870732987} | 8.9898 |
71
- | 0.0031 | 16.0 | 3600 | 0.0126 | 81.0150 | {'rouge1': 0.9404629080499822, 'rouge2': 0.8720324522971583, 'rougeL': 0.9356927255750787, 'rougeLsum': 0.9345623053846737} | 8.9898 |
72
- | 0.0028 | 17.0 | 3825 | 0.0126 | 80.8287 | {'rouge1': 0.9411435870201352, 'rouge2': 0.8724553795877326, 'rougeL': 0.9359551340472394, 'rougeLsum': 0.9350289359763041} | 8.7118 |
73
- | 0.0036 | 18.0 | 4050 | 0.0125 | 81.6804 | {'rouge1': 0.9439651134469248, 'rouge2': 0.8776258833758834, 'rougeL': 0.9387663409002418, 'rougeLsum': 0.9383033053977328} | 8.7118 |
74
- | 0.0031 | 19.0 | 4275 | 0.0126 | 82.5361 | {'rouge1': 0.9431080888925318, 'rouge2': 0.8796675154910447, 'rougeL': 0.9389213173307603, 'rougeLsum': 0.9384271187189147} | 8.5264 |
75
- | 0.0024 | 20.0 | 4500 | 0.0126 | 82.8676 | {'rouge1': 0.9437468226218229, 'rouge2': 0.8812697966521498, 'rougeL': 0.9395239597433869, 'rougeLsum': 0.939101609432879} | 8.4337 |
76
 
77
 
78
  ### Framework versions
 
18
 
19
  This model is a fine-tuned version of [vgaraujov/bart-base-spanish](https://huggingface.co/vgaraujov/bart-base-spanish) on an unknown dataset.
20
  It achieves the following results on the evaluation set:
21
+ - Loss: 0.0123
22
+ - Bleu: 81.8551
23
+ - Rouge: {'rouge1': 0.9422515866486456, 'rouge2': 0.8737405002405003, 'rougeL': 0.9363672046907345, 'rougeLsum': 0.9364728490463785}
24
+ - Ter: 8.7118
25
 
26
  ## Model description
27
 
 
53
 
54
  | Training Loss | Epoch | Step | Validation Loss | Bleu | Rouge | Ter |
55
  |:-------------:|:-----:|:----:|:---------------:|:-------:|:---------------------------------------------------------------------------------------------------------------------------:|:-------:|
56
+ | 0.0324 | 1.0 | 225 | 0.0225 | 72.7749 | {'rouge1': 0.8830902523402526, 'rouge2': 0.7709874297815476, 'rougeL': 0.8694410309905668, 'rougeLsum': 0.869743878469885} | 16.4968 |
57
+ | 0.0187 | 2.0 | 450 | 0.0155 | 81.9344 | {'rouge1': 0.9237037532184591, 'rouge2': 0.8457443112443113, 'rougeL': 0.9173110054433588, 'rougeLsum': 0.9176172563819627} | 10.2873 |
58
+ | 0.0109 | 3.0 | 675 | 0.0142 | 79.3413 | {'rouge1': 0.9307991409462, 'rouge2': 0.8545628630628632, 'rougeL': 0.9241576974224035, 'rougeLsum': 0.9239856347356347} | 10.8434 |
59
+ | 0.0099 | 4.0 | 900 | 0.0123 | 82.4245 | {'rouge1': 0.9380482866806397, 'rouge2': 0.8707410459910461, 'rougeL': 0.9337147808618397, 'rougeLsum': 0.9338772787669846} | 8.9898 |
60
+ | 0.0115 | 5.0 | 1125 | 0.0117 | 80.3604 | {'rouge1': 0.9482994702665755, 'rouge2': 0.8712202111613877, 'rougeL': 0.942820963393332, 'rougeLsum': 0.942393967315794} | 8.6191 |
61
+ | 0.0056 | 6.0 | 1350 | 0.0117 | 83.0304 | {'rouge1': 0.9462984866440752, 'rouge2': 0.8715856458356457, 'rougeL': 0.9409380815263171, 'rougeLsum': 0.9412039578068991} | 8.4337 |
62
+ | 0.0059 | 7.0 | 1575 | 0.0119 | 83.0528 | {'rouge1': 0.9496951399993196, 'rouge2': 0.8794314791961855, 'rougeL': 0.9442460554581298, 'rougeLsum': 0.9445281533052429} | 8.1557 |
63
+ | 0.0055 | 8.0 | 1800 | 0.0119 | 82.0772 | {'rouge1': 0.9461830571389397, 'rouge2': 0.8765663040663043, 'rougeL': 0.9411501096942276, 'rougeLsum': 0.9412948766919356} | 8.9898 |
64
+ | 0.0045 | 9.0 | 2025 | 0.0124 | 81.5960 | {'rouge1': 0.9417869646693177, 'rouge2': 0.8676474946622006, 'rougeL': 0.935177818769924, 'rougeLsum': 0.9352072609193355} | 8.8044 |
65
+ | 0.0046 | 10.0 | 2250 | 0.0123 | 80.3279 | {'rouge1': 0.9406776813371245, 'rouge2': 0.8716705772441067, 'rougeL': 0.9355530020947977, 'rougeLsum': 0.9350984560102209} | 8.9898 |
66
+ | 0.0041 | 11.0 | 2475 | 0.0118 | 81.1506 | {'rouge1': 0.9449248578219166, 'rouge2': 0.8736089204912735, 'rougeL': 0.9394655745870917, 'rougeLsum': 0.9396245046663005} | 8.7118 |
67
+ | 0.004 | 12.0 | 2700 | 0.0121 | 82.4137 | {'rouge1': 0.9479337149778327, 'rouge2': 0.8761151903651905, 'rougeL': 0.9422136735813209, 'rougeLsum': 0.9425275606746195} | 8.1557 |
68
+ | 0.0035 | 13.0 | 2925 | 0.0121 | 81.4307 | {'rouge1': 0.9436979997127055, 'rouge2': 0.8760786305198072, 'rougeL': 0.9377141821886406, 'rougeLsum': 0.9378051091495366} | 8.5264 |
69
+ | 0.0034 | 14.0 | 3150 | 0.0118 | 81.7553 | {'rouge1': 0.9440729475203159, 'rouge2': 0.8736759498671265, 'rougeL': 0.9381740514387574, 'rougeLsum': 0.9378773147217421} | 8.9898 |
70
+ | 0.0037 | 15.0 | 3375 | 0.0121 | 81.6178 | {'rouge1': 0.9456137800108388, 'rouge2': 0.873859483109483, 'rougeL': 0.9394098205715855, 'rougeLsum': 0.9399457127839486} | 8.7118 |
71
+ | 0.0028 | 16.0 | 3600 | 0.0122 | 81.1136 | {'rouge1': 0.9433953611747732, 'rouge2': 0.8706926129426129, 'rougeL': 0.9381087131822429, 'rougeLsum': 0.9380460381122143} | 8.8971 |
72
+ | 0.0029 | 17.0 | 3825 | 0.0123 | 81.8608 | {'rouge1': 0.941960338680927, 'rouge2': 0.8727757427757428, 'rougeL': 0.9359009315847551, 'rougeLsum': 0.936447181903064} | 8.8044 |
73
+ | 0.0029 | 18.0 | 4050 | 0.0123 | 81.6538 | {'rouge1': 0.9453945182784191, 'rouge2': 0.8744925183748715, 'rougeL': 0.9399012401856829, 'rougeLsum': 0.9405087715002577} | 8.6191 |
74
+ | 0.0027 | 19.0 | 4275 | 0.0123 | 81.9450 | {'rouge1': 0.9431345337668868, 'rouge2': 0.8752672512672515, 'rougeL': 0.937374804117451, 'rougeLsum': 0.937653051197169} | 8.6191 |
75
+ | 0.0026 | 20.0 | 4500 | 0.0123 | 81.8551 | {'rouge1': 0.9422515866486456, 'rouge2': 0.8737405002405003, 'rougeL': 0.9363672046907345, 'rougeLsum': 0.9364728490463785} | 8.7118 |
76
 
77
 
78
  ### Framework versions