|
--- |
|
license: apache-2.0 |
|
base_model: fairnightzz/t5-small-finetuned-notes2anki-v1 |
|
tags: |
|
- generated_from_keras_callback |
|
model-index: |
|
- name: fairnightzz/t5-small-finetuned-notes2anki-v1 |
|
results: [] |
|
--- |
|
|
|
<!-- This model card has been generated automatically according to the information Keras had access to. You should |
|
probably proofread and complete it, then remove this comment. --> |
|
|
|
# fairnightzz/t5-small-finetuned-notes2anki-v1 |
|
|
|
This model is a fine-tuned version of [fairnightzz/t5-small-finetuned-notes2anki-v1](https://huggingface.co/fairnightzz/t5-small-finetuned-notes2anki-v1) on an unknown dataset. |
|
It achieves the following results on the evaluation set: |
|
- Train Loss: 2.0038 |
|
- Validation Loss: 1.8288 |
|
- Train Rouge1: 13.1471 |
|
- Train Rouge2: 8.0633 |
|
- Train Rougel: 11.5696 |
|
- Train Rougelsum: 12.9462 |
|
- Train Gen Len: 19.0 |
|
- Epoch: 19 |
|
|
|
## Model description |
|
|
|
More information needed |
|
|
|
## Intended uses & limitations |
|
|
|
More information needed |
|
|
|
## Training and evaluation data |
|
|
|
More information needed |
|
|
|
## Training procedure |
|
|
|
### Training hyperparameters |
|
|
|
The following hyperparameters were used during training: |
|
- optimizer: {'name': 'AdamWeightDecay', 'learning_rate': 2e-05, 'decay': 0.0, 'beta_1': 0.9, 'beta_2': 0.999, 'epsilon': 1e-07, 'amsgrad': False, 'weight_decay_rate': 0.01} |
|
- training_precision: float32 |
|
|
|
### Training results |
|
|
|
| Train Loss | Validation Loss | Train Rouge1 | Train Rouge2 | Train Rougel | Train Rougelsum | Train Gen Len | Epoch | |
|
|:----------:|:---------------:|:------------:|:------------:|:------------:|:---------------:|:-------------:|:-----:| |
|
| 3.4022 | 2.7364 | 11.2311 | 4.8587 | 8.7075 | 10.4700 | 19.0 | 0 | |
|
| 3.1245 | 2.5569 | 10.5563 | 4.2629 | 8.3375 | 9.8786 | 19.0 | 1 | |
|
| 2.9024 | 2.4407 | 11.8667 | 6.4823 | 9.7059 | 11.2729 | 19.0 | 2 | |
|
| 2.7711 | 2.3598 | 11.8220 | 7.0101 | 10.1169 | 11.6068 | 19.0 | 3 | |
|
| 2.6620 | 2.2961 | 10.8857 | 5.9477 | 9.2469 | 10.6552 | 19.0 | 4 | |
|
| 2.5896 | 2.2397 | 11.2067 | 6.5960 | 9.7992 | 10.9471 | 19.0 | 5 | |
|
| 2.5014 | 2.1927 | 9.9929 | 5.4838 | 8.5468 | 9.7819 | 19.0 | 6 | |
|
| 2.4545 | 2.1455 | 10.8128 | 5.8837 | 8.7679 | 10.3815 | 19.0 | 7 | |
|
| 2.3996 | 2.1049 | 11.3686 | 5.9480 | 8.9953 | 10.6468 | 19.0 | 8 | |
|
| 2.3564 | 2.0707 | 10.7723 | 5.1838 | 8.6172 | 10.1052 | 19.0 | 9 | |
|
| 2.3213 | 2.0349 | 11.2138 | 5.9159 | 9.1719 | 10.5998 | 19.0 | 10 | |
|
| 2.2527 | 2.0028 | 10.9398 | 6.1004 | 9.2349 | 10.1944 | 19.0 | 11 | |
|
| 2.2318 | 1.9755 | 10.9252 | 6.2422 | 9.1758 | 10.1406 | 19.0 | 12 | |
|
| 2.1920 | 1.9456 | 11.1478 | 6.5824 | 9.6520 | 10.6710 | 19.0 | 13 | |
|
| 2.1522 | 1.9267 | 11.3610 | 6.4087 | 9.9797 | 10.9126 | 19.0 | 14 | |
|
| 2.1173 | 1.9031 | 11.3989 | 6.5776 | 10.1344 | 10.9575 | 19.0 | 15 | |
|
| 2.0782 | 1.8845 | 13.2115 | 8.1938 | 11.6289 | 12.9284 | 19.0 | 16 | |
|
| 2.0779 | 1.8688 | 13.1524 | 8.1482 | 11.5699 | 12.8713 | 19.0 | 17 | |
|
| 2.0447 | 1.8506 | 13.2316 | 8.2242 | 11.6640 | 12.9850 | 19.0 | 18 | |
|
| 2.0038 | 1.8288 | 13.1471 | 8.0633 | 11.5696 | 12.9462 | 19.0 | 19 | |
|
|
|
|
|
### Framework versions |
|
|
|
- Transformers 4.35.2 |
|
- TensorFlow 2.15.0 |
|
- Datasets 2.16.1 |
|
- Tokenizers 0.15.0 |
|
|
