End of training

README.md

@@ -15,9 +15,9 @@ should probably proofread and complete it, then remove this comment. -->
 
 This model is a fine-tuned version of [VietAI/ViT5-base](https://huggingface.co/VietAI/ViT5-base) on the None dataset.
 It achieves the following results on the evaluation set:
-- Loss: 0.2250
-- Bleu Score: 73.5528
-- Gen Len: 13.2038
+- Loss: 0.2171
+- Bleu Score: 75.3569
+- Gen Len: 13.1514
 
 ## Model description
 
@@ -36,19 +36,21 @@ More information needed
 ### Training hyperparameters
 
 The following hyperparameters were used during training:
-- learning_rate: 0.0001
+- learning_rate: 0.0002
 - train_batch_size: 16
 - eval_batch_size: 16
 - seed: 42
 - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
 - lr_scheduler_type: linear
-- num_epochs: 1
+- num_epochs: 3
 
 ### Training results
 
 | Training Loss | Epoch | Step | Validation Loss | Bleu Score | Gen Len |
 |:-------------:|:-----:|:----:|:---------------:|:----------:|:-------:|
-| 0.4321        | 1.0   | 524  | 0.2250          | 73.5528    | 13.2038 |
+| 0.4669        | 1.0   | 524  | 0.2426          | 73.5538    | 13.1838 |
+| 0.1732        | 2.0   | 1048 | 0.2127          | 74.877     | 13.1457 |
+| 0.0691        | 3.0   | 1572 | 0.2171          | 75.3569    | 13.1514 |
 
 
 ### Framework versions

logs/events.out.tfevents.1715162721.9d64bdbf39aa.33975.0

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:8ba2e3d3abf038d9d2582ae8f1c33b81a1cb46e50f960ed0432f3cfe2870de66
-size 6682
+oid sha256:e18f3a55cb1ed7658c342dca1d89ef91617f64d8ecb1cd0ac166e0a449a00ebb
+size 7036

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:4e06739a40f3581a432c43e4329bad0a77905da8dae883e89806a4532cfb041a
+oid sha256:adeac3b72c78d65a8171a50fe063e8265ce8575e0b093d748a63e7d4434fe889
 size 903834408