Training in progress epoch 0

README.md

@@ -14,8 +14,8 @@ probably proofread and complete it, then remove this comment. -->
 
 This model is a fine-tuned version of [distilbert-base-uncased](https://huggingface.co/distilbert-base-uncased) on an unknown dataset.
 It achieves the following results on the evaluation set:
-- Train Loss: 5.7467
-- Validation Loss: 4.6359
+- Train Loss: 4.2701
+- Validation Loss: 2.6432
 - Epoch: 0
 
 ## Model description
@@ -42,12 +42,12 @@ The following hyperparameters were used during training:
 
 | Train Loss | Validation Loss | Epoch |
 |:----------:|:---------------:|:-----:|
-| 5.7467     | 4.6359          | 0     |
+| 4.2701     | 2.6432          | 0     |
 
 
 ### Framework versions
 
-- Transformers 4.29.0
+- Transformers 4.29.1
 - TensorFlow 2.12.0
 - Datasets 2.12.0
 - Tokenizers 0.13.3

config.json

@@ -18,6 +18,6 @@
   "seq_classif_dropout": 0.2,
   "sinusoidal_pos_embds": false,
   "tie_weights_": true,
-  "transformers_version": "4.29.0",
+  "transformers_version": "4.29.1",
   "vocab_size": 30522
 }

tf_model.h5

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:7cb6318a7b49ace2009055ef4a42e463912371f4feebe87c73ae28c41d2334d6
+oid sha256:d26490b527425cf81ab5e4de90df7abf54ee789d4aa08cccdaf4c416cf49b574
 size 363423648