End of training

README.md

@@ -1,6 +1,6 @@
 ---
-license: mit
-base_model: roberta-base
+license: apache-2.0
+base_model: facebook/blenderbot_small-90M
 tags:
 - generated_from_trainer
 datasets:
@@ -15,9 +15,9 @@ should probably proofread and complete it, then remove this comment. -->
 
 # my_awesome_eli5_clm-model
 
-This model is a fine-tuned version of [roberta-base](https://huggingface.co/roberta-base) on the eli5_category dataset.
+This model is a fine-tuned version of [facebook/blenderbot_small-90M](https://huggingface.co/facebook/blenderbot_small-90M) on the eli5_category dataset.
 It achieves the following results on the evaluation set:
-- Loss: 4.0051
+- Loss: 0.0597
 
 ## Model description
 
@@ -48,9 +48,9 @@ The following hyperparameters were used during training:
 
 | Training Loss | Epoch | Step | Validation Loss |
 |:-------------:|:-----:|:----:|:---------------:|
-| 4.3754        | 1.0   | 1321 | 4.0959          |
-| 4.098         | 2.0   | 2642 | 4.0268          |
-| 3.987         | 3.0   | 3963 | 4.0051          |
+| 0.1053        | 1.0   | 1402 | 0.0618          |
+| 0.0668        | 2.0   | 2804 | 0.0599          |
+| 0.0572        | 3.0   | 4206 | 0.0597          |
 
 
 ### Framework versions

generation_config.json

@@ -1,7 +1,14 @@
 {
   "_from_model_config": true,
-  "bos_token_id": 0,
+  "bos_token_id": 1,
+  "decoder_start_token_id": 1,
   "eos_token_id": 2,
-  "pad_token_id": 1,
+  "forced_eos_token_id": 2,
+  "length_penalty": 0.65,
+  "max_length": 128,
+  "min_length": 20,
+  "no_repeat_ngram_size": 3,
+  "num_beams": 10,
+  "pad_token_id": 0,
   "transformers_version": "4.40.0"
 }

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:95113329771d2c7e2adfae685888952047e4305617bdf5f10ba7c49ec9f81aab
+oid sha256:eb2f971d56c784a7d1c5b55aaeab1c10045d56ba27aaf460859230dbc16674be
 size 248131760

runs/Apr25_09-03-49_818c51180a1a/events.out.tfevents.1714035830.818c51180a1a.212.0

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:6afc9f536c8c954c85c3be63a08ee5602737229c46da92a2fb5f0f6e68510d54
-size 7838
+oid sha256:05fbfb23af47eae56e5a7b8ed8cafee41828ba49b04eace7cd0b7bc87dfa4540
+size 8463

runs/Apr25_09-03-49_818c51180a1a/events.out.tfevents.1714036183.818c51180a1a.212.1

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:5d711fa2d8512cf0c6de34be970b8aeb51a5077634ae3273776bf032455fa865
+size 359