Model save

README.md

@@ -1,5 +1,6 @@
 ---
-base_model: luqh/ClinicalT5-base
+license: apache-2.0
+base_model: google/flan-t5-base
 tags:
 - generated_from_trainer
 datasets:
@@ -21,7 +22,7 @@ model-index:
     metrics:
     - name: Rouge1
       type: rouge
-      value: 50.0
+      value: 59.0
 ---
 
 <!-- This model card has been generated automatically according to the information the Trainer had access to. You
@@ -29,14 +30,14 @@ should probably proofread and complete it, then remove this comment. -->
 
 # run1
 
-This model is a fine-tuned version of [luqh/ClinicalT5-base](https://huggingface.co/luqh/ClinicalT5-base) on the sem_eval_2024_task_2 dataset.
+This model is a fine-tuned version of [google/flan-t5-base](https://huggingface.co/google/flan-t5-base) on the sem_eval_2024_task_2 dataset.
 It achieves the following results on the evaluation set:
-- Loss: 0.2336
-- Rouge1: 50.0
+- Loss: 0.3506
+- Rouge1: 59.0
 - Rouge2: 0.0
-- Rougel: 50.0
-- Rougelsum: 50.0
-- Gen Len: 2.22
+- Rougel: 59.0
+- Rougelsum: 58.75
+- Gen Len: 2.0
 
 ## Model description
 
@@ -64,27 +65,26 @@ The following hyperparameters were used during training:
 - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
 - lr_scheduler_type: linear
 - num_epochs: 10
-- mixed_precision_training: Native AMP
 
 ### Training results
 
 | Training Loss | Epoch | Step | Validation Loss | Rouge1 | Rouge2 | Rougel | Rougelsum | Gen Len |
 |:-------------:|:-----:|:----:|:---------------:|:------:|:------:|:------:|:---------:|:-------:|
-| No log        | 1.0   | 212  | 0.2358          | 50.5   | 0.0    | 50.5   | 50.5      | 3.93    |
-| 1.8021        | 2.0   | 425  | 0.2346          | 50.5   | 0.0    | 50.5   | 50.5      | 3.73    |
-| 1.8021        | 3.0   | 637  | 0.2347          | 50.0   | 0.0    | 50.0   | 50.0      | 2.04    |
-| 0.2555        | 4.0   | 850  | 0.2342          | 51.0   | 0.0    | 51.0   | 51.0      | 3.46    |
-| 0.2555        | 5.0   | 1062 | 0.2333          | 50.5   | 0.0    | 50.5   | 50.5      | 2.33    |
-| 0.2518        | 6.0   | 1275 | 0.2327          | 51.0   | 0.0    | 51.0   | 50.5      | 2.52    |
-| 0.2518        | 7.0   | 1487 | 0.2351          | 50.0   | 0.0    | 50.0   | 50.0      | 2.0     |
-| 0.2516        | 8.0   | 1700 | 0.2354          | 50.0   | 0.0    | 50.0   | 50.0      | 2.0     |
-| 0.2516        | 9.0   | 1912 | 0.2329          | 52.0   | 0.0    | 52.0   | 51.5      | 2.42    |
-| 0.2516        | 9.98  | 2120 | 0.2336          | 50.0   | 0.0    | 50.0   | 50.0      | 2.22    |
+| No log        | 1.0   | 212  | 0.3327          | 58.0   | 0.0    | 58.0   | 58.0      | 2.0     |
+| 0.3828        | 2.0   | 425  | 0.3269          | 59.0   | 0.0    | 59.0   | 59.0      | 2.0     |
+| 0.3828        | 3.0   | 637  | 0.3392          | 59.0   | 0.0    | 59.0   | 59.0      | 2.0     |
+| 0.3608        | 4.0   | 850  | 0.3264          | 60.5   | 0.0    | 60.5   | 60.5      | 2.0     |
+| 0.3608        | 5.0   | 1062 | 0.3293          | 59.0   | 0.0    | 59.0   | 59.0      | 2.0     |
+| 0.3494        | 6.0   | 1275 | 0.3324          | 60.5   | 0.0    | 60.5   | 60.5      | 2.0     |
+| 0.3494        | 7.0   | 1487 | 0.3448          | 61.0   | 0.0    | 61.0   | 61.0      | 2.0     |
+| 0.3328        | 8.0   | 1700 | 0.3462          | 59.5   | 0.0    | 59.5   | 59.5      | 2.0     |
+| 0.3328        | 9.0   | 1912 | 0.3491          | 59.5   | 0.0    | 59.5   | 59.5      | 2.0     |
+| 0.3328        | 9.98  | 2120 | 0.3506          | 59.0   | 0.0    | 59.0   | 58.75     | 2.0     |
 
 
 ### Framework versions
 
 - Transformers 4.35.2
 - Pytorch 2.1.0+cu121
-- Datasets 2.15.0
+- Datasets 2.16.1
 - Tokenizers 0.15.0

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:9739bdaf27c0e0b0650a9ed5311be113fd685fe9466b85e413dbe961c28d8e63
+oid sha256:5b981cbf163a3315b81060a4d86f7aa0fd8747024f405495220b9f7f4d94dffa
 size 990345064