|
--- |
|
license: apache-2.0 |
|
base_model: bedus-creation/t5-small-dataset-i-lim-to-eng |
|
tags: |
|
- generated_from_keras_callback |
|
model-index: |
|
- name: bedus-creation/t5-small-dataset-i-lim-to-eng-003 |
|
results: [] |
|
--- |
|
|
|
<!-- This model card has been generated automatically according to the information Keras had access to. You should |
|
probably proofread and complete it, then remove this comment. --> |
|
|
|
# bedus-creation/t5-small-dataset-i-lim-to-eng-003 |
|
|
|
This model is a fine-tuned version of [bedus-creation/t5-small-dataset-i-lim-to-eng](https://huggingface.co/bedus-creation/t5-small-dataset-i-lim-to-eng) on an unknown dataset. |
|
It achieves the following results on the evaluation set: |
|
- Train Loss: 0.0193 |
|
- Validation Loss: 0.2406 |
|
- Epoch: 140 |
|
|
|
## Model description |
|
|
|
More information needed |
|
|
|
## Intended uses & limitations |
|
|
|
More information needed |
|
|
|
## Training and evaluation data |
|
|
|
More information needed |
|
|
|
## Training procedure |
|
|
|
### Training hyperparameters |
|
|
|
The following hyperparameters were used during training: |
|
- optimizer: {'name': 'AdamWeightDecay', 'learning_rate': 2e-05, 'decay': 0.0, 'beta_1': 0.9, 'beta_2': 0.999, 'epsilon': 1e-07, 'amsgrad': False, 'weight_decay_rate': 0.01} |
|
- training_precision: float32 |
|
|
|
### Training results |
|
|
|
| Train Loss | Validation Loss | Epoch | |
|
|:----------:|:---------------:|:-----:| |
|
| 0.1690 | 0.1414 | 0 | |
|
| 0.1533 | 0.1296 | 1 | |
|
| 0.1523 | 0.1231 | 2 | |
|
| 0.1481 | 0.1228 | 3 | |
|
| 0.1450 | 0.1153 | 4 | |
|
| 0.1393 | 0.1138 | 5 | |
|
| 0.1336 | 0.1114 | 6 | |
|
| 0.1311 | 0.1103 | 7 | |
|
| 0.1267 | 0.1114 | 8 | |
|
| 0.1251 | 0.1084 | 9 | |
|
| 0.1263 | 0.1072 | 10 | |
|
| 0.1202 | 0.1090 | 11 | |
|
| 0.1126 | 0.1100 | 12 | |
|
| 0.1136 | 0.1141 | 13 | |
|
| 0.1056 | 0.1086 | 14 | |
|
| 0.1067 | 0.1053 | 15 | |
|
| 0.1095 | 0.1095 | 16 | |
|
| 0.1031 | 0.1069 | 17 | |
|
| 0.0960 | 0.1139 | 18 | |
|
| 0.0976 | 0.1065 | 19 | |
|
| 0.0964 | 0.1053 | 20 | |
|
| 0.0929 | 0.1055 | 21 | |
|
| 0.0912 | 0.1077 | 22 | |
|
| 0.0933 | 0.1045 | 23 | |
|
| 0.0887 | 0.1102 | 24 | |
|
| 0.0884 | 0.1041 | 25 | |
|
| 0.0868 | 0.1138 | 26 | |
|
| 0.0891 | 0.1101 | 27 | |
|
| 0.0858 | 0.1173 | 28 | |
|
| 0.0824 | 0.1063 | 29 | |
|
| 0.0837 | 0.1041 | 30 | |
|
| 0.0784 | 0.1171 | 31 | |
|
| 0.0785 | 0.1113 | 32 | |
|
| 0.0820 | 0.1099 | 33 | |
|
| 0.0740 | 0.1129 | 34 | |
|
| 0.0735 | 0.1182 | 35 | |
|
| 0.0745 | 0.1158 | 36 | |
|
| 0.0751 | 0.1153 | 37 | |
|
| 0.0729 | 0.1131 | 38 | |
|
| 0.0693 | 0.1154 | 39 | |
|
| 0.0661 | 0.1171 | 40 | |
|
| 0.0633 | 0.1197 | 41 | |
|
| 0.0689 | 0.1171 | 42 | |
|
| 0.0593 | 0.1180 | 43 | |
|
| 0.0657 | 0.1185 | 44 | |
|
| 0.0576 | 0.1169 | 45 | |
|
| 0.0596 | 0.1206 | 46 | |
|
| 0.0599 | 0.1229 | 47 | |
|
| 0.0597 | 0.1180 | 48 | |
|
| 0.0507 | 0.1256 | 49 | |
|
| 0.0577 | 0.1206 | 50 | |
|
| 0.0530 | 0.1281 | 51 | |
|
| 0.0538 | 0.1244 | 52 | |
|
| 0.0498 | 0.1215 | 53 | |
|
| 0.0487 | 0.1385 | 54 | |
|
| 0.0470 | 0.1336 | 55 | |
|
| 0.0478 | 0.1303 | 56 | |
|
| 0.0472 | 0.1336 | 57 | |
|
| 0.0445 | 0.1604 | 58 | |
|
| 0.0488 | 0.1391 | 59 | |
|
| 0.0463 | 0.1478 | 60 | |
|
| 0.0467 | 0.1341 | 61 | |
|
| 0.0403 | 0.1467 | 62 | |
|
| 0.0370 | 0.1514 | 63 | |
|
| 0.0438 | 0.1644 | 64 | |
|
| 0.0502 | 0.1422 | 65 | |
|
| 0.0386 | 0.1503 | 66 | |
|
| 0.0370 | 0.1471 | 67 | |
|
| 0.0400 | 0.1423 | 68 | |
|
| 0.0388 | 0.1444 | 69 | |
|
| 0.0357 | 0.1651 | 70 | |
|
| 0.0307 | 0.1751 | 71 | |
|
| 0.0306 | 0.1713 | 72 | |
|
| 0.0285 | 0.1650 | 73 | |
|
| 0.0317 | 0.1629 | 74 | |
|
| 0.0367 | 0.1772 | 75 | |
|
| 0.0341 | 0.1592 | 76 | |
|
| 0.0330 | 0.1590 | 77 | |
|
| 0.0287 | 0.1638 | 78 | |
|
| 0.0319 | 0.1604 | 79 | |
|
| 0.0256 | 0.1733 | 80 | |
|
| 0.0267 | 0.1736 | 81 | |
|
| 0.0271 | 0.1746 | 82 | |
|
| 0.0264 | 0.1843 | 83 | |
|
| 0.0271 | 0.1800 | 84 | |
|
| 0.0292 | 0.1751 | 85 | |
|
| 0.0283 | 0.1910 | 86 | |
|
| 0.0258 | 0.1864 | 87 | |
|
| 0.0228 | 0.1821 | 88 | |
|
| 0.0253 | 0.1875 | 89 | |
|
| 0.0211 | 0.1846 | 90 | |
|
| 0.0210 | 0.1902 | 91 | |
|
| 0.0288 | 0.1962 | 92 | |
|
| 0.0196 | 0.2071 | 93 | |
|
| 0.0207 | 0.2053 | 94 | |
|
| 0.0184 | 0.2031 | 95 | |
|
| 0.0200 | 0.2099 | 96 | |
|
| 0.0235 | 0.2027 | 97 | |
|
| 0.0183 | 0.2034 | 98 | |
|
| 0.0268 | 0.2116 | 99 | |
|
| 0.0180 | 0.2024 | 100 | |
|
| 0.0205 | 0.2085 | 101 | |
|
| 0.0203 | 0.2072 | 102 | |
|
| 0.0186 | 0.2075 | 103 | |
|
| 0.0189 | 0.2121 | 104 | |
|
| 0.0199 | 0.2118 | 105 | |
|
| 0.0190 | 0.2220 | 106 | |
|
| 0.0182 | 0.2143 | 107 | |
|
| 0.0136 | 0.2213 | 108 | |
|
| 0.0202 | 0.2218 | 109 | |
|
| 0.0151 | 0.2183 | 110 | |
|
| 0.0135 | 0.2267 | 111 | |
|
| 0.0133 | 0.2274 | 112 | |
|
| 0.0183 | 0.2433 | 113 | |
|
| 0.0169 | 0.2462 | 114 | |
|
| 0.0156 | 0.2340 | 115 | |
|
| 0.0160 | 0.2384 | 116 | |
|
| 0.0149 | 0.2497 | 117 | |
|
| 0.0131 | 0.2528 | 118 | |
|
| 0.0207 | 0.2387 | 119 | |
|
| 0.0133 | 0.2451 | 120 | |
|
| 0.0143 | 0.2299 | 121 | |
|
| 0.0176 | 0.2286 | 122 | |
|
| 0.0125 | 0.2377 | 123 | |
|
| 0.0128 | 0.2407 | 124 | |
|
| 0.0157 | 0.2450 | 125 | |
|
| 0.0121 | 0.2536 | 126 | |
|
| 0.0139 | 0.2527 | 127 | |
|
| 0.0141 | 0.2509 | 128 | |
|
| 0.0093 | 0.2509 | 129 | |
|
| 0.0151 | 0.2589 | 130 | |
|
| 0.0114 | 0.2520 | 131 | |
|
| 0.0126 | 0.2599 | 132 | |
|
| 0.0109 | 0.2648 | 133 | |
|
| 0.0106 | 0.2593 | 134 | |
|
| 0.0118 | 0.2744 | 135 | |
|
| 0.0192 | 0.2526 | 136 | |
|
| 0.0129 | 0.2431 | 137 | |
|
| 0.0110 | 0.2484 | 138 | |
|
| 0.0137 | 0.2453 | 139 | |
|
| 0.0193 | 0.2406 | 140 | |
|
|
|
|
|
### Framework versions |
|
|
|
- Transformers 4.33.2 |
|
- TensorFlow 2.13.0 |
|
- Datasets 2.14.5 |
|
- Tokenizers 0.13.3 |
|
|
