End of training

README.md

@@ -3,6 +3,8 @@ license: apache-2.0
 base_model: facebook/bart-base
 tags:
 - generated_from_trainer
+metrics:
+- rouge
 model-index:
 - name: bart_booksum_1
   results: []
@@ -13,7 +15,14 @@ should probably proofread and complete it, then remove this comment. -->
 
 # bart_booksum_1
 
-This model is a fine-tuned version of [facebook/bart-base](https://huggingface.co/facebook/bart-base) on an unknown dataset.
+This model is a fine-tuned version of [facebook/bart-base](https://huggingface.co/facebook/bart-base) on the None dataset.
+It achieves the following results on the evaluation set:
+- Loss: 3.0264
+- Rouge1: 0.1795
+- Rouge2: 0.0368
+- Rougel: 0.1337
+- Rougelsum: 0.1334
+- Gen Len: 20.0
 
 ## Model description
 
@@ -33,17 +42,27 @@ More information needed
 
 The following hyperparameters were used during training:
 - learning_rate: 2e-05
-- train_batch_size: 16
-- eval_batch_size: 16
-- seed: 42
+- train_batch_size: 4
+- eval_batch_size: 4
+- seed: 1515
 - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
 - lr_scheduler_type: linear
 - num_epochs: 4
 - mixed_precision_training: Native AMP
 
+### Training results
+
+| Training Loss | Epoch | Step | Validation Loss | Rouge1 | Rouge2 | Rougel | Rougelsum | Gen Len |
+|:-------------:|:-----:|:----:|:---------------:|:------:|:------:|:------:|:---------:|:-------:|
+| 3.8176        | 1.0   | 80   | 3.0712          | 0.1765 | 0.0372 | 0.1298 | 0.1299    | 20.0    |
+| 3.3835        | 2.0   | 160  | 3.0365          | 0.1871 | 0.0444 | 0.1382 | 0.1382    | 20.0    |
+| 3.2162        | 3.0   | 240  | 3.0281          | 0.1892 | 0.0426 | 0.1385 | 0.1383    | 20.0    |
+| 3.1147        | 4.0   | 320  | 3.0264          | 0.1795 | 0.0368 | 0.1337 | 0.1334    | 20.0    |
+
+
 ### Framework versions
 
-- Transformers 4.36.2
+- Transformers 4.37.0
 - Pytorch 2.1.2+cu118
 - Datasets 2.16.1
-- Tokenizers 0.15.0
+- Tokenizers 0.15.1

events.out.tfevents.1706019888.hatimf.28637.0

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:aed9aa10ca8089fd700c8b3e789df07e07a177eeac5a5e39847543898a90d740
-size 8294
+oid sha256:76ff3578c482f244230812dbb69a80681db03675e5cc32d4717e78d246367bbf
+size 9349

events.out.tfevents.1706180148.hatimf.81666.0

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:907dff40fc85ac93f6eda9da0cb128e606b9f5072eb8d4ea1d5cef83dda3e95d
+size 8609

generation_config.json

@@ -1,5 +1,4 @@
 {
-  "_from_model_config": true,
   "bos_token_id": 0,
   "decoder_start_token_id": 2,
   "early_stopping": true,
@@ -9,5 +8,5 @@
   "no_repeat_ngram_size": 3,
   "num_beams": 4,
   "pad_token_id": 1,
-  "transformers_version": "4.36.2"
+  "transformers_version": "4.37.0"
 }

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:c40c88ad1d24853e6b05056d0159b72b020c8ba94aeb7d1e72fcfe74618142ae
+oid sha256:e952f9cddbe335deab4b691429b84c1452ccd31879936e6097afad90dc11424d
 size 557912620

tokenizer.json

@@ -2,7 +2,7 @@
   "version": "1.0",
   "truncation": {
     "direction": "Right",
-    "max_length": 32768,
+    "max_length": 128,
     "strategy": "LongestFirst",
     "stride": 0
   },

training_args.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:ae5a463904e3f59612f194e9f968b72d1e3bf4458d9d4c0fe27d83a10056a6a5
+oid sha256:be72ec32dd9adce1399e5b597555da1760466ca4f92baee43a7d697caf25d6c3
 size 4792