End of training

README.md

@@ -15,9 +15,9 @@ should probably proofread and complete it, then remove this comment. -->
 
 This model is a fine-tuned version of [Salesforce/codet5-small](https://huggingface.co/Salesforce/codet5-small) on an unknown dataset.
 It achieves the following results on the evaluation set:
-- Loss: 0.7318
-- Bleu Score: 0.0626
-- Gen Len: 13.7838
+- Loss: 0.7389
+- Bleu Score: 0.0638
+- Gen Len: 13.4595
 
 ## Model description
 
@@ -49,9 +49,9 @@ The following hyperparameters were used during training:
 
 | Training Loss | Epoch | Step | Validation Loss | Bleu Score | Gen Len |
 |:-------------:|:-----:|:----:|:---------------:|:----------:|:-------:|
-| No log        | 1.0   | 20   | 1.7693          | 0.0619     | 13.5946 |
-| No log        | 2.0   | 40   | 1.0720          | 0.0625     | 13.9189 |
-| No log        | 3.0   | 60   | 0.7318          | 0.0626     | 13.7838 |
+| No log        | 1.0   | 20   | 1.7607          | 0.0633     | 13.3514 |
+| No log        | 2.0   | 40   | 1.0844          | 0.0597     | 14.1081 |
+| No log        | 3.0   | 60   | 0.7389          | 0.0638     | 13.4595 |
 
 
 ### Framework versions

added_tokens.json

@@ -0,0 +1,4 @@
+{
+  "[BUG]": 32100,
+  "[CONTEXT]": 32101
+}

config.json

@@ -65,5 +65,5 @@
   "torch_dtype": "float32",
   "transformers_version": "4.38.0.dev0",
   "use_cache": true,
-  "vocab_size": 32100
+  "vocab_size": 32102
 }

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:0689c80f3777e5fbf33d485d38379770973a3808964da813f7de77a6553c5c13
-size 241984552
+oid sha256:bb40db33c98cdf08c3b92375ce0ff17e7efd6ec7a43e8bebf31bc6dd29f547d2
+size 241988648

runs/Jan27_10-09-01_93c475004482/events.out.tfevents.1706350142.93c475004482.26652.0

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:28141e092cd093015c5274b835005c384d4fe418ae247272fdb6a7615e9d5c8e
+size 7018

tokenizer.json

@@ -952,6 +952,24 @@
       "rstrip": false,
       "normalized": true,
       "special": true
+    },
+    {
+      "id": 32100,
+      "content": "[BUG]",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": true,
+      "special": false
+    },
+    {
+      "id": 32101,
+      "content": "[CONTEXT]",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": true,
+      "special": false
     }
   ],
   "normalizer": null,

tokenizer_config.json

@@ -840,6 +840,22 @@
       "rstrip": false,
       "single_word": false,
       "special": true
+    },
+    "32100": {
+      "content": "[BUG]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "32101": {
+      "content": "[CONTEXT]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
     }
   },
   "additional_special_tokens": [

training_args.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:7b1bf561b915ed245b194bede3230c72ad968fc30523f3f167a48ea3f326413d
+oid sha256:9a0845d8e0925a9f4c8292255a504fb0dfbc480c5cd2e1f58c1549b8347783bd
 size 4920