End of training

README.md

@@ -0,0 +1,58 @@
+---
+license: apache-2.0
+base_model: t5-small
+tags:
+- generated_from_trainer
+datasets:
+- pubmed-summarization
+model-index:
+- name: pubmed_summarization
+  results: []
+---
+
+<!-- This model card has been generated automatically according to the information the Trainer had access to. You
+should probably proofread and complete it, then remove this comment. -->
+
+# pubmed_summarization
+
+This model is a fine-tuned version of [t5-small](https://huggingface.co/t5-small) on the pubmed-summarization dataset.
+
+## Model description
+
+More information needed
+
+## Intended uses & limitations
+
+More information needed
+
+## Training and evaluation data
+
+More information needed
+
+## Training procedure
+
+### Training hyperparameters
+
+The following hyperparameters were used during training:
+- learning_rate: 2e-05
+- train_batch_size: 16
+- eval_batch_size: 16
+- seed: 42
+- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
+- lr_scheduler_type: linear
+- num_epochs: 1
+- mixed_precision_training: Native AMP
+
+### Training results
+
+| Training Loss | Epoch | Step | Validation Loss | Rouge1 | Rouge2 | Rougel | Rougelsum | Gen Len |
+|:-------------:|:-----:|:----:|:---------------:|:------:|:------:|:------:|:---------:|:-------:|
+| No log        | 1.0   | 417  | 2.4062          | 0.137  | 0.0532 | 0.1153 | 0.1152    | 18.9946 |
+
+
+### Framework versions
+
+- Transformers 4.35.0
+- Pytorch 2.1.0+cu118
+- Datasets 2.14.6
+- Tokenizers 0.14.1

generation_config.json

@@ -0,0 +1,6 @@
+{
+  "decoder_start_token_id": 0,
+  "eos_token_id": 1,
+  "pad_token_id": 0,
+  "transformers_version": "4.35.0"
+}

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:9d338dd0b00943e44403d01ac0a302b8a7a897c87993c6f2e22289ea97211216
+oid sha256:f2541d85da37d07a58c3af5dbb00a94cffd63f921a9a06f6ba8a3fd6209ccb53
 size 242041896

runs/Nov11_04-40-21_764a9fe3e102/events.out.tfevents.1699677627.764a9fe3e102.224.0

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:65f5c0013571531a34dffa42ab97956b068f06881801f40b731ecf7f447e9dc8
+size 5204

runs/Nov11_04-40-49_764a9fe3e102/events.out.tfevents.1699677650.764a9fe3e102.224.1

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:64152069bdc0187130d243ea43f0aa8b61919fe3570ff505a039cbd8028d0eec
+size 6083

training_args.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:51496f6feac4c239b28a64a1609a8e02366cc8346def76f3aad0e1b46c4e0f01
+oid sha256:2be82e3d7a26ca10638342d0fc65aec27292abbf28ac433564ea44915da8f05a
 size 4728