End of training

README.md

@@ -16,9 +16,9 @@ should probably proofread and complete it, then remove this comment. -->
 
 This model is a fine-tuned version of [google/flan-t5-base](https://huggingface.co/google/flan-t5-base) on the None dataset.
 It achieves the following results on the evaluation set:
-- Loss: 0.1042
-- Bleu Score: 24.4829
-- Gen Len: 18.816
+- Loss: 0.1150
+- Bleu Score: 26.5557
+- Gen Len: 19.718
 
 ## Model description
 
@@ -41,23 +41,22 @@ The following hyperparameters were used during training:
 - train_batch_size: 16
 - eval_batch_size: 16
 - seed: 42
-- optimizer: Use adamw_torch with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
+- optimizer: Use OptimizerNames.ADAMW_TORCH with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
 - lr_scheduler_type: linear
-- num_epochs: 4
+- num_epochs: 3
 
 ### Training results
 
 | Training Loss | Epoch | Step | Validation Loss | Bleu Score | Gen Len |
 |:-------------:|:-----:|:----:|:---------------:|:----------:|:-------:|
-| 0.2337        | 1.0   | 419  | 0.1422          | 23.4722    | 18.8088 |
-| 0.1441        | 2.0   | 838  | 0.1186          | 24.2104    | 18.8041 |
-| 0.1185        | 3.0   | 1257 | 0.1077          | 24.3846    | 18.8124 |
-| 0.1069        | 4.0   | 1676 | 0.1042          | 24.4829    | 18.816  |
+| 0.2345        | 1.0   | 419  | 0.1435          | 25.5785    | 19.7168 |
+| 0.1464        | 2.0   | 838  | 0.1197          | 26.3365    | 19.7121 |
+| 0.1238        | 3.0   | 1257 | 0.1150          | 26.5557    | 19.718  |
 
 
 ### Framework versions
 
-- Transformers 4.46.2
-- Pytorch 2.5.0+cu121
-- Datasets 3.1.0
-- Tokenizers 0.20.3
+- Transformers 4.48.3
+- Pytorch 2.5.1+cu124
+- Datasets 3.3.2
+- Tokenizers 0.21.0

generation_config.json

@@ -2,5 +2,5 @@
   "decoder_start_token_id": 0,
   "eos_token_id": 1,
   "pad_token_id": 0,
-  "transformers_version": "4.46.2"
+  "transformers_version": "4.48.3"
 }

logs/events.out.tfevents.1740118308.8cb29d035291.816.0

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:327b9004cffeda95d8de1edcb67d62d2eaf41551217f6f3f6183a1ab7afea483
-size 6662
+oid sha256:46996405ae05b27b4f4924400893b44f1c4a920208e6fb09458e1d044e64c94c
+size 8190

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:76c5a3d296274fde91f52b85f9a3f07f196f5b26fccab17db48975ab2e7c4b78
+oid sha256:20a0a9bb3d1286cc529978bb3326b651c143da56d4eb3f9b1a63cf10b8659678
 size 990345064