End

README.md

@@ -1,8 +1,8 @@
 ---
 license: apache-2.0
+base_model: google/flan-t5-large
 tags:
 - generated_from_trainer
-base_model: google/flan-t5-large
 model-index:
 - name: events-mem-large
   results: []
@@ -35,28 +35,26 @@ More information needed
 
 The following hyperparameters were used during training:
 - learning_rate: 2e-05
-- train_batch_size: 8
-- eval_batch_size: 8
+- train_batch_size: 1
+- eval_batch_size: 1
 - seed: 42
+- gradient_accumulation_steps: 4
+- total_train_batch_size: 4
 - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
 - lr_scheduler_type: linear
-- num_epochs: 5
+- training_steps: 10
 - mixed_precision_training: Native AMP
 
 ### Training results
 
-| Training Loss | Epoch | Step  | Validation Loss |
-|:-------------:|:-----:|:-----:|:---------------:|
-| 0.0           | 1.0   | 2660  | nan             |
-| 0.0           | 2.0   | 5320  | nan             |
-| 0.0           | 3.0   | 7980  | nan             |
-| 0.0           | 4.0   | 10640 | nan             |
-| 0.0           | 5.0   | 13300 | nan             |
+| Training Loss | Epoch  | Step | Validation Loss |
+|:-------------:|:------:|:----:|:---------------:|
+| 0.0           | 0.0075 | 10   | nan             |
 
 
 ### Framework versions
 
-- Transformers 4.39.3
-- Pytorch 2.1.2
-- Datasets 2.17.0
-- Tokenizers 0.15.2
+- Transformers 4.40.1
+- Pytorch 2.2.1+cu121
+- Datasets 2.19.0
+- Tokenizers 0.19.1

generation_config.json

@@ -3,5 +3,5 @@
   "decoder_start_token_id": 0,
   "eos_token_id": 1,
   "pad_token_id": 0,
-  "transformers_version": "4.39.3"
+  "transformers_version": "4.40.1"
 }

training_args.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:59ac6162a3a883df8b9dd14451369f34366e8d5a475b5d1368409d7b024a7634
+oid sha256:da5567c187362d4ce2b165e8d79e725eb17c6e170346fae024d570a608f0b7c1
 size 5112