training completed[dev]: 1024 128

README.md

@@ -0,0 +1,81 @@
+---
+license: apache-2.0
+base_model: facebook/bart-large
+tags:
+- generated_from_trainer
+metrics:
+- rouge
+- wer
+model-index:
+- name: bart_bertsum_1024_375_1000
+  results: []
+---
+
+<!-- This model card has been generated automatically according to the information the Trainer had access to. You
+should probably proofread and complete it, then remove this comment. -->
+
+# bart_bertsum_1024_375_1000
+
+This model is a fine-tuned version of [facebook/bart-large](https://huggingface.co/facebook/bart-large) on an unknown dataset.
+It achieves the following results on the evaluation set:
+- Loss: 1.0535
+- Rouge1: 0.6801
+- Rouge2: 0.4119
+- Rougel: 0.6159
+- Rougelsum: 0.616
+- Wer: 0.4729
+- Bleurt: -0.3664
+
+## Model description
+
+More information needed
+
+## Intended uses & limitations
+
+More information needed
+
+## Training and evaluation data
+
+More information needed
+
+## Training procedure
+
+### Training hyperparameters
+
+The following hyperparameters were used during training:
+- learning_rate: 2e-05
+- train_batch_size: 6
+- eval_batch_size: 6
+- seed: 42
+- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
+- lr_scheduler_type: linear
+- num_epochs: 2
+- mixed_precision_training: Native AMP
+
+### Training results
+
+| Training Loss | Epoch | Step | Validation Loss | Rouge1 | Rouge2 | Rougel | Rougelsum | Wer    | Bleurt  |
+|:-------------:|:-----:|:----:|:---------------:|:------:|:------:|:------:|:---------:|:------:|:-------:|
+| No log        | 0.13  | 250  | 1.2919          | 0.636  | 0.3519 | 0.567  | 0.567     | 0.5296 | -0.0182 |
+| 2.2326        | 0.27  | 500  | 1.2002          | 0.6503 | 0.3707 | 0.5816 | 0.5817    | 0.5113 | -0.7073 |
+| 2.2326        | 0.4   | 750  | 1.1735          | 0.6564 | 0.3791 | 0.5898 | 0.5898    | 0.5048 | -0.3421 |
+| 1.2886        | 0.53  | 1000 | 1.1476          | 0.661  | 0.3843 | 0.594  | 0.5939    | 0.4994 | 0.0835  |
+| 1.2886        | 0.66  | 1250 | 1.1289          | 0.6615 | 0.3863 | 0.5938 | 0.5938    | 0.4945 | -0.5247 |
+| 1.2306        | 0.8   | 1500 | 1.1197          | 0.67   | 0.3952 | 0.6046 | 0.6045    | 0.4909 | -0.192  |
+| 1.2306        | 0.93  | 1750 | 1.1077          | 0.6734 | 0.3989 | 0.6068 | 0.6067    | 0.4876 | -0.3867 |
+| 1.1852        | 1.06  | 2000 | 1.0917          | 0.6731 | 0.4027 | 0.609  | 0.609     | 0.4833 | -0.6453 |
+| 1.1852        | 1.2   | 2250 | 1.0852          | 0.6707 | 0.4013 | 0.6054 | 0.6054    | 0.4824 | -0.5589 |
+| 1.0875        | 1.33  | 2500 | 1.0785          | 0.6738 | 0.4049 | 0.6096 | 0.6096    | 0.4794 | -0.5107 |
+| 1.0875        | 1.46  | 2750 | 1.0709          | 0.6743 | 0.4046 | 0.6096 | 0.6095    | 0.478  | -0.3387 |
+| 1.0857        | 1.6   | 3000 | 1.0627          | 0.6778 | 0.41   | 0.6137 | 0.6137    | 0.4757 | -0.4275 |
+| 1.0857        | 1.73  | 3250 | 1.0636          | 0.675  | 0.4088 | 0.6121 | 0.612     | 0.4745 | -0.3664 |
+| 1.0634        | 1.86  | 3500 | 1.0552          | 0.6775 | 0.4103 | 0.6136 | 0.6136    | 0.4729 | -0.3664 |
+| 1.0634        | 1.99  | 3750 | 1.0535          | 0.6801 | 0.4119 | 0.6159 | 0.616     | 0.4729 | -0.3664 |
+
+
+### Framework versions
+
+- Transformers 4.38.2
+- Pytorch 2.2.1+cu121
+- Datasets 2.18.0
+- Tokenizers 0.15.2

generation_config.json

@@ -0,0 +1,13 @@
+{
+  "_from_model_config": true,
+  "bos_token_id": 0,
+  "decoder_start_token_id": 2,
+  "early_stopping": true,
+  "eos_token_id": 2,
+  "forced_bos_token_id": 0,
+  "forced_eos_token_id": 2,
+  "no_repeat_ngram_size": 3,
+  "num_beams": 4,
+  "pad_token_id": 1,
+  "transformers_version": "4.38.2"
+}

runs/Mar20_06-23-47_5fae63380177/events.out.tfevents.1710915838.5fae63380177.302.0

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:07e38762ab5ce95780e70e25a5759ece264d9207c7037323f2a5ee91a5965f1e
-size 13918
+oid sha256:0bad29c9db9bfffbe4f6106438bd831d3b05ed40416d45497d0d8376aad156a4
+size 16196