End of training

README.md

@@ -1,38 +1,22 @@
 ---
 license: apache-2.0
 tags:
-- generated_from_trainer
-datasets:
-- glue
-metrics:
-- matthews_correlation
+- generated_from_keras_callback
 model-index:
 - name: bert-fine-tuned-cola
-  results:
-  - task:
-      name: Text Classification
-      type: text-classification
-    dataset:
-      name: glue
-      type: glue
-      config: cola
-      split: validation
-      args: cola
-    metrics:
-    - name: Matthews Correlation
-      type: matthews_correlation
-      value: 0.5812018675459495
+  results: []
 ---
 
-<!-- This model card has been generated automatically according to the information the Trainer had access to. You
-should probably proofread and complete it, then remove this comment. -->
+<!-- This model card has been generated automatically according to the information Keras had access to. You should
+probably proofread and complete it, then remove this comment. -->
 
 # bert-fine-tuned-cola
 
-This model is a fine-tuned version of [bert-base-cased](https://huggingface.co/bert-base-cased) on the glue dataset.
+This model is a fine-tuned version of [bert-base-cased](https://huggingface.co/bert-base-cased) on an unknown dataset.
 It achieves the following results on the evaluation set:
-- Loss: 0.7990
-- Matthews Correlation: 0.5812
+- Train Loss: 0.2898
+- Validation Loss: 0.4519
+- Epoch: 1
 
 ## Model description
 
@@ -51,26 +35,20 @@ More information needed
 ### Training hyperparameters
 
 The following hyperparameters were used during training:
-- learning_rate: 2e-05
-- train_batch_size: 8
-- eval_batch_size: 8
-- seed: 42
-- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
-- lr_scheduler_type: linear
-- num_epochs: 3
+- optimizer: {'name': 'AdamWeightDecay', 'learning_rate': 2e-05, 'decay': 0.0, 'beta_1': 0.9, 'beta_2': 0.999, 'epsilon': 1e-07, 'amsgrad': False, 'weight_decay_rate': 0.01}
+- training_precision: float32
 
 ### Training results
 
-| Training Loss | Epoch | Step | Validation Loss | Matthews Correlation |
-|:-------------:|:-----:|:----:|:---------------:|:--------------------:|
-| 0.4818        | 1.0   | 1069 | 0.5447          | 0.5127               |
-| 0.3375        | 2.0   | 2138 | 0.6218          | 0.5767               |
-| 0.194         | 3.0   | 3207 | 0.7990          | 0.5812               |
+| Train Loss | Validation Loss | Epoch |
+|:----------:|:---------------:|:-----:|
+| 0.4925     | 0.4193          | 0     |
+| 0.2898     | 0.4519          | 1     |
 
 
 ### Framework versions
 
 - Transformers 4.27.2
-- Pytorch 1.13.1+cu116
+- TensorFlow 2.11.0
 - Datasets 2.10.1
 - Tokenizers 0.13.2

config.json

@@ -9,16 +9,8 @@
   "hidden_act": "gelu",
   "hidden_dropout_prob": 0.1,
   "hidden_size": 768,
-  "id2label": {
-    "0": "unacceptable",
-    "1": "acceptable"
-  },
   "initializer_range": 0.02,
   "intermediate_size": 3072,
-  "label2id": {
-    "acceptable": "1",
-    "unacceptable": "0"
-  },
   "layer_norm_eps": 1e-12,
   "max_position_embeddings": 512,
   "model_type": "bert",
@@ -26,8 +18,6 @@
   "num_hidden_layers": 12,
   "pad_token_id": 0,
   "position_embedding_type": "absolute",
-  "problem_type": "single_label_classification",
-  "torch_dtype": "float32",
   "transformers_version": "4.27.2",
   "type_vocab_size": 2,
   "use_cache": true,

tf_model.h5

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:89ab85eb3f56727e86a6e692be1453f695e51fb72806318528fec1b4abe092ee
+size 433535256