End of training

README.md

@@ -0,0 +1,70 @@
+---
+tags:
+- generated_from_trainer
+metrics:
+- rouge
+- bleu
+model-index:
+- name: t5-small
+  results: []
+---
+
+<!-- This model card has been generated automatically according to the information the Trainer had access to. You
+should probably proofread and complete it, then remove this comment. -->
+
+# t5-small
+
+This model was trained from scratch on an unknown dataset.
+It achieves the following results on the evaluation set:
+- Loss: 1.6644
+- Rouge1: 58.4345
+- Rouge2: 35.6298
+- Rougel: 56.7347
+- Rougelsum: 56.768
+- Bleu: 0.2405
+
+## Model description
+
+More information needed
+
+## Intended uses & limitations
+
+More information needed
+
+## Training and evaluation data
+
+More information needed
+
+## Training procedure
+
+### Training hyperparameters
+
+The following hyperparameters were used during training:
+- learning_rate: 5e-05
+- train_batch_size: 64
+- eval_batch_size: 64
+- seed: 42
+- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
+- lr_scheduler_type: linear
+- num_epochs: 3
+
+### Training results
+
+| Training Loss | Epoch | Step  | Validation Loss | Rouge1  | Rouge2  | Rougel  | Rougelsum | Bleu   |
+|:-------------:|:-----:|:-----:|:---------------:|:-------:|:-------:|:-------:|:---------:|:------:|
+| 1.8479        | 0.34  | 3000  | 1.7017          | 58.311  | 35.3602 | 56.618  | 56.6461   | 0.2379 |
+| 1.8327        | 0.68  | 6000  | 1.6922          | 58.3222 | 35.4329 | 56.6269 | 56.6666   | 0.2385 |
+| 1.8236        | 1.01  | 9000  | 1.6832          | 58.3368 | 35.42   | 56.6223 | 56.6611   | 0.2382 |
+| 1.8046        | 1.35  | 12000 | 1.6784          | 58.4461 | 35.538  | 56.7423 | 56.779    | 0.2394 |
+| 1.8078        | 1.69  | 15000 | 1.6718          | 58.4257 | 35.566  | 56.7209 | 56.7558   | 0.2394 |
+| 1.7989        | 2.03  | 18000 | 1.6688          | 58.4162 | 35.6118 | 56.7173 | 56.7626   | 0.2402 |
+| 1.7945        | 2.37  | 21000 | 1.6661          | 58.444  | 35.6166 | 56.7463 | 56.7845   | 0.2401 |
+| 1.7907        | 2.71  | 24000 | 1.6644          | 58.4345 | 35.6298 | 56.7347 | 56.768    | 0.2405 |
+
+
+### Framework versions
+
+- Transformers 4.36.2
+- Pytorch 1.13.0+cu117
+- Datasets 2.4.0
+- Tokenizers 0.15.0

generation_config.json

@@ -0,0 +1,6 @@
+{
+  "decoder_start_token_id": 0,
+  "eos_token_id": 1,
+  "pad_token_id": 0,
+  "transformers_version": "4.36.2"
+}

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:78b30933df736e89141f98a0a7b33e79bbc0925a1eb748e1f21bdc8fc88a2973
+oid sha256:4cd288c1dedb2a163f4c9f954192b4c920d33bfe716c3b04720ce21416234810
 size 242041896

runs/Dec29_15-50-45_n1y9t1aejz/events.out.tfevents.1703865068.n1y9t1aejz.383.0

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:f0b2f53e515799ec2f8807ed8e8f17f37ff995aa496ec749b10a41badd717826
-size 17896
+oid sha256:ec92774e5ba14d5a963f91bfa1f6b145504c3ba33f99077c66fd6bc94ca44476
+size 18256