Training complete

README.md

@@ -0,0 +1,71 @@
+---
+license: apache-2.0
+base_model: google/mt5-small
+tags:
+- summarization
+- generated_from_trainer
+metrics:
+- rouge
+model-index:
+- name: mt5-small-News
+  results: []
+---
+
+<!-- This model card has been generated automatically according to the information the Trainer had access to. You
+should probably proofread and complete it, then remove this comment. -->
+
+# mt5-small-News
+
+This model is a fine-tuned version of [google/mt5-small](https://huggingface.co/google/mt5-small) on an unknown dataset.
+It achieves the following results on the evaluation set:
+- Loss: 2.4331
+- Rouge1: 6.6074
+- Rouge2: 0.8
+- Rougel: 6.5487
+- Rougelsum: 6.6233
+
+## Model description
+
+More information needed
+
+## Intended uses & limitations
+
+More information needed
+
+## Training and evaluation data
+
+More information needed
+
+## Training procedure
+
+### Training hyperparameters
+
+The following hyperparameters were used during training:
+- learning_rate: 5.6e-05
+- train_batch_size: 8
+- eval_batch_size: 8
+- seed: 42
+- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
+- lr_scheduler_type: linear
+- num_epochs: 8
+
+### Training results
+
+| Training Loss | Epoch | Step | Validation Loss | Rouge1 | Rouge2 | Rougel | Rougelsum |
+|:-------------:|:-----:|:----:|:---------------:|:------:|:------:|:------:|:---------:|
+| 5.7796        | 1.0   | 625  | 2.7282          | 4.0839 | 0.8785 | 4.0421 | 4.0758    |
+| 3.4978        | 2.0   | 1250 | 2.6171          | 6.6481 | 0.9067 | 6.6002 | 6.6437    |
+| 3.2419        | 3.0   | 1875 | 2.5208          | 6.6661 | 0.64   | 6.5897 | 6.6246    |
+| 3.1063        | 4.0   | 2500 | 2.4918          | 7.2246 | 1.0467 | 7.1758 | 7.1947    |
+| 3.0177        | 5.0   | 3125 | 2.4535          | 6.8523 | 1.0    | 6.8009 | 6.8923    |
+| 2.9537        | 6.0   | 3750 | 2.4452          | 6.459  | 0.8667 | 6.4208 | 6.481     |
+| 2.9156        | 7.0   | 4375 | 2.4373          | 6.5019 | 0.8    | 6.4421 | 6.5094    |
+| 2.8914        | 8.0   | 5000 | 2.4331          | 6.6074 | 0.8    | 6.5487 | 6.6233    |
+
+
+### Framework versions
+
+- Transformers 4.37.2
+- Pytorch 2.1.0+cu121
+- Datasets 2.17.1
+- Tokenizers 0.15.2

generation_config.json

@@ -0,0 +1,6 @@
+{
+  "decoder_start_token_id": 0,
+  "eos_token_id": 1,
+  "pad_token_id": 0,
+  "transformers_version": "4.37.2"
+}

runs/Feb28_14-35-16_9ab7f4dbd27c/events.out.tfevents.1709130949.9ab7f4dbd27c.3081.0

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:2279e6a81787f5383c408d89885202098ca01f512c41ff93d8cd65b5cfaf7201
-size 9202
+oid sha256:ce3f93fc28831c16c0bb52d359f84a8b31e0c0bca8a313ae1c3bbd5dbcb3a9ff
+size 10030

runs/Feb28_14-35-16_9ab7f4dbd27c/events.out.tfevents.1709132503.9ab7f4dbd27c.3081.1

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:191f50a2fb8f77bcf2da70f7655c91692cc1cf48186c9ddd42d1f0c4d4ed9071
+size 562