nightner/roberta2roberta_financial_lora_test

README.md

@@ -4,6 +4,8 @@ license: apache-2.0
 base_model: google/roberta2roberta_L-24_cnn_daily_mail
 tags:
 - generated_from_trainer
+metrics:
+- rouge
 model-index:
 - name: results
   results: []
@@ -15,6 +17,14 @@ should probably proofread and complete it, then remove this comment. -->
 # results
 
 This model is a fine-tuned version of [google/roberta2roberta_L-24_cnn_daily_mail](https://huggingface.co/google/roberta2roberta_L-24_cnn_daily_mail) on the None dataset.
+It achieves the following results on the evaluation set:
+- Loss: 3.7671
+- Rouge1: 46.04
+- Rouge2: 24.94
+- Rougel: 33.78
+- Bertscore P: 87.25
+- Bertscore R: 85.03
+- Bertscore F1: 86.02
 
 ## Model description
 
@@ -34,18 +44,26 @@ More information needed
 
 The following hyperparameters were used during training:
 - learning_rate: 3e-05
-- train_batch_size: 1
-- eval_batch_size: 1
+- train_batch_size: 2
+- eval_batch_size: 2
 - seed: 42
 - gradient_accumulation_steps: 4
-- total_train_batch_size: 4
+- total_train_batch_size: 8
 - optimizer: Use OptimizerNames.ADAMW_TORCH with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
 - lr_scheduler_type: cosine
 - lr_scheduler_warmup_ratio: 0.1
-- num_epochs: 2
+- num_epochs: 5
 
 ### Training results
 
+| Training Loss | Epoch | Step | Validation Loss | Rouge1 | Rouge2 | Rougel | Bertscore P | Bertscore R | Bertscore F1 |
+|:-------------:|:-----:|:----:|:---------------:|:------:|:------:|:------:|:-----------:|:-----------:|:------------:|
+| No log        | 0.8   | 10   | 4.1610          | 43.72  | 22.28  | 31.23  | 86.78       | 84.54       | 85.57        |
+| No log        | 1.56  | 20   | 4.0149          | 45.37  | 23.55  | 32.49  | 86.84       | 84.74       | 85.69        |
+| No log        | 2.32  | 30   | 3.8893          | 45.05  | 24.14  | 32.83  | 87.15       | 84.71       | 85.82        |
+| No log        | 3.08  | 40   | 3.8113          | 45.1   | 24.05  | 32.37  | 87.11       | 85.08       | 85.98        |
+| 18.8832       | 3.88  | 50   | 3.7732          | 45.98  | 24.85  | 33.82  | 87.13       | 85.03       | 85.96        |
+| 18.8832       | 4.64  | 60   | 3.7671          | 46.04  | 24.94  | 33.78  | 87.25       | 85.03       | 86.02        |
 
 
 ### Framework versions

adapter_model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:f20a5878c5a29172631a6d46392abdf34ad993f38f6d82c722b0de4039d4bff3
+oid sha256:a8d59f86d472fff550241f97e76b627a0bb06b176e8abbd4eedb26b1dbd72995
 size 12611432

training_args.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:8dc5f579cc66a9036edaf3ee5dd83e61a062d15ef795941b759c9960498df95c
+oid sha256:9be7a562e9528b9f6ee315e6d75d62f3ea6982b49644339a058467afe79ae474
 size 5432