Training in progress epoch 0

README.md

@@ -15,13 +15,13 @@ probably proofread and complete it, then remove this comment. -->
 
 This model is a fine-tuned version of [google-bert/bert-base-uncased](https://huggingface.co/google-bert/bert-base-uncased) on an unknown dataset.
 It achieves the following results on the evaluation set:
-- Train Loss: 0.2943
-- Validation Loss: 0.5154
-- Train Accuracy: 0.8145
-- Train Precision: 0.8130
-- Train Recall: 0.8145
-- Train F1: 0.8123
-- Epoch: 2
+- Train Loss: 0.5459
+- Validation Loss: 0.7333
+- Train Accuracy: 0.6880
+- Train Precision: 0.7015
+- Train Recall: 0.6880
+- Train F1: 0.6863
+- Epoch: 0
 
 ## Model description
 
@@ -40,21 +40,19 @@ More information needed
 ### Training hyperparameters
 
 The following hyperparameters were used during training:
-- optimizer: {'name': 'Adam', 'weight_decay': None, 'clipnorm': None, 'global_clipnorm': None, 'clipvalue': None, 'use_ema': False, 'ema_momentum': 0.99, 'ema_overwrite_frequency': None, 'jit_compile': True, 'is_legacy_optimizer': False, 'learning_rate': {'module': 'keras.optimizers.schedules', 'class_name': 'PolynomialDecay', 'config': {'initial_learning_rate': 2e-05, 'decay_steps': 18780, 'end_learning_rate': 0.0, 'power': 1.0, 'cycle': False, 'name': None}, 'registered_name': None}, 'beta_1': 0.9, 'beta_2': 0.999, 'epsilon': 1e-08, 'amsgrad': False}
+- optimizer: {'name': 'Adam', 'weight_decay': None, 'clipnorm': None, 'global_clipnorm': None, 'clipvalue': None, 'use_ema': False, 'ema_momentum': 0.99, 'ema_overwrite_frequency': None, 'jit_compile': True, 'is_legacy_optimizer': False, 'learning_rate': {'module': 'keras.optimizers.schedules', 'class_name': 'PolynomialDecay', 'config': {'initial_learning_rate': 2e-05, 'decay_steps': 90930, 'end_learning_rate': 0.0, 'power': 1.0, 'cycle': False, 'name': None}, 'registered_name': None}, 'beta_1': 0.9, 'beta_2': 0.999, 'epsilon': 1e-08, 'amsgrad': False}
 - training_precision: float32
 
 ### Training results
 
 | Train Loss | Validation Loss | Train Accuracy | Train Precision | Train Recall | Train F1 | Epoch |
 |:----------:|:---------------:|:--------------:|:---------------:|:------------:|:--------:|:-----:|
-| 0.7207     | 0.5929          | 0.7559         | 0.7512          | 0.7559       | 0.7520   | 0     |
-| 0.4594     | 0.4977          | 0.8052         | 0.8043          | 0.8052       | 0.8046   | 1     |
-| 0.2943     | 0.5154          | 0.8145         | 0.8130          | 0.8145       | 0.8123   | 2     |
+| 0.5459     | 0.7333          | 0.6880         | 0.7015          | 0.6880       | 0.6863   | 0     |
 
 
 ### Framework versions
 
-- Transformers 4.40.2
+- Transformers 4.41.0
 - TensorFlow 2.15.0
 - Datasets 2.19.1
 - Tokenizers 0.19.1

config.json

@@ -10,16 +10,16 @@
   "hidden_dropout_prob": 0.1,
   "hidden_size": 768,
   "id2label": {
-    "0": "NOT ENOUGH INFO",
-    "1": "SUPPORTS",
-    "2": "REFUTES"
+    "0": "SUPPORTS",
+    "1": "REFUTES",
+    "2": "NOT ENOUGH INFO"
   },
   "initializer_range": 0.02,
   "intermediate_size": 3072,
   "label2id": {
-    "NOT ENOUGH INFO": 0,
-    "REFUTES": 2,
-    "SUPPORTS": 1
+    "NOT ENOUGH INFO": 2,
+    "REFUTES": 1,
+    "SUPPORTS": 0
   },
   "layer_norm_eps": 1e-12,
   "max_position_embeddings": 512,
@@ -29,7 +29,7 @@
   "pad_token_id": 0,
   "position_embedding_type": "absolute",
   "problem_type": "multi_label_classification",
-  "transformers_version": "4.40.2",
+  "transformers_version": "4.41.0",
   "type_vocab_size": 2,
   "use_cache": true,
   "vocab_size": 30522

logs/train/events.out.tfevents.1716351588.935214a22de4.5785.0.v2

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d7c18da95085660382eee0160a45b730c19005b862275d6bc12cdb1cd4666ad5
+size 3745779

logs/validation/events.out.tfevents.1716352186.935214a22de4.5785.1.v2

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:7cbb7a7308b4296966a6a73a6ed7401541181b7100689c3ab604500f320c0a9c
+size 232

tf_model.h5

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:e9331e087361c3fd76653bd6e34b39b03201a381bb9b1a275ddd40ffb7fc71f1
+oid sha256:de6f1be4bbcd3cc419202363bd89fd2187f615a3f63110560783523d0c3a6eb9
 size 438226204