End of training

README.md

@@ -1,6 +1,4 @@
 ---
-license: apache-2.0
-base_model: t5-small
 tags:
 - generated_from_trainer
 datasets:
@@ -22,7 +20,7 @@ model-index:
     metrics:
     - name: Bleu
       type: bleu
-      value: 3.3638
+      value: 4.9544
 ---
 
 <!-- This model card has been generated automatically according to the information the Trainer had access to. You
@@ -30,11 +28,11 @@ should probably proofread and complete it, then remove this comment. -->
 
 # my_awesome_opus_books_model
 
-This model is a fine-tuned version of [t5-small](https://huggingface.co/t5-small) on the opus_books dataset.
+This model was trained from scratch on the opus_books dataset.
 It achieves the following results on the evaluation set:
-- Loss: 2.9186
-- Bleu: 3.3638
-- Gen Len: 16.5639
+- Loss: 2.6349
+- Bleu: 4.9544
+- Gen Len: 16.4563
 
 ## Model description
 
@@ -59,13 +57,17 @@ The following hyperparameters were used during training:
 - seed: 42
 - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
 - lr_scheduler_type: linear
-- num_epochs: 1
+- num_epochs: 5
 
 ### Training results
 
-| Training Loss | Epoch | Step | Validation Loss | Bleu   | Gen Len |
-|:-------------:|:-----:|:----:|:---------------:|:------:|:-------:|
-| 3.2114        | 1.0   | 2574 | 2.9186          | 3.3638 | 16.5639 |
+| Training Loss | Epoch | Step  | Validation Loss | Bleu   | Gen Len |
+|:-------------:|:-----:|:-----:|:---------------:|:------:|:-------:|
+| 3.0491        | 1.0   | 2574  | 2.7656          | 4.2008 | 16.5119 |
+| 2.9604        | 2.0   | 5148  | 2.6959          | 4.589  | 16.4523 |
+| 2.9114        | 3.0   | 7722  | 2.6601          | 4.8097 | 16.461  |
+| 2.8991        | 4.0   | 10296 | 2.6408          | 4.9246 | 16.4609 |
+| 2.8777        | 5.0   | 12870 | 2.6349          | 4.9544 | 16.4563 |
 
 
 ### Framework versions

pytorch_model.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:1082c1256af33e2276910dcb06f95354a516a572104fd7678e814d54176681f8
+oid sha256:5f96c0e6fc599ea10a27864d2b65834ed1a7d40ee99e8d50e2f791764377ab2b
 size 242071641