Training in progress epoch 0

README.md

@@ -1,53 +1,26 @@
 ---
 license: apache-2.0
 tags:
-- generated_from_trainer
-datasets:
-- wnut_17
-metrics:
-- precision
-- recall
-- f1
-- accuracy
+- generated_from_keras_callback
 model-index:
-- name: my_awesome_wnut_model
-  results:
-  - task:
-      name: Token Classification
-      type: token-classification
-    dataset:
-      name: wnut_17
-      type: wnut_17
-      config: wnut_17
-      split: train
-      args: wnut_17
-    metrics:
-    - name: Precision
-      type: precision
-      value: 0.5310245310245311
-    - name: Recall
-      type: recall
-      value: 0.3410565338276182
-    - name: F1
-      type: f1
-      value: 0.4153498871331829
-    - name: Accuracy
-      type: accuracy
-      value: 0.9433542815612842
+- name: stevhliu/my_awesome_wnut_model
+  results: []
 ---
 
-<!-- This model card has been generated automatically according to the information the Trainer had access to. You
-should probably proofread and complete it, then remove this comment. -->
+<!-- This model card has been generated automatically according to the information Keras had access to. You should
+probably proofread and complete it, then remove this comment. -->
 
-# my_awesome_wnut_model
+# stevhliu/my_awesome_wnut_model
 
-This model is a fine-tuned version of [distilbert-base-uncased](https://huggingface.co/distilbert-base-uncased) on the wnut_17 dataset.
+This model is a fine-tuned version of [distilbert-base-uncased](https://huggingface.co/distilbert-base-uncased) on an unknown dataset.
 It achieves the following results on the evaluation set:
-- Loss: 0.2699
-- Precision: 0.5310
-- Recall: 0.3411
-- F1: 0.4153
-- Accuracy: 0.9434
+- Train Loss: 0.3233
+- Validation Loss: 0.3099
+- Train Precision: 0.4155
+- Train Recall: 0.2117
+- Train F1: 0.2805
+- Train Accuracy: 0.9333
+- Epoch: 0
 
 ## Model description
 
@@ -66,26 +39,19 @@ More information needed
 ### Training hyperparameters
 
 The following hyperparameters were used during training:
-- learning_rate: 2e-05
-- train_batch_size: 16
-- eval_batch_size: 16
-- seed: 42
-- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
-- lr_scheduler_type: linear
-- num_epochs: 3
+- optimizer: {'name': 'AdamWeightDecay', 'learning_rate': {'class_name': 'PolynomialDecay', 'config': {'initial_learning_rate': 2e-05, 'decay_steps': 636, 'end_learning_rate': 0.0, 'power': 1.0, 'cycle': False, 'name': None}}, 'decay': 0.0, 'beta_1': 0.9, 'beta_2': 0.999, 'epsilon': 1e-08, 'amsgrad': False, 'weight_decay_rate': 0.01}
+- training_precision: float32
 
 ### Training results
 
-| Training Loss | Epoch | Step | Validation Loss | Precision | Recall | F1     | Accuracy |
-|:-------------:|:-----:|:----:|:---------------:|:---------:|:------:|:------:|:--------:|
-| No log        | 1.0   | 213  | 0.2802          | 0.5587    | 0.2956 | 0.3867 | 0.9393   |
-| No log        | 2.0   | 426  | 0.2642          | 0.5698    | 0.3216 | 0.4111 | 0.9422   |
-| 0.188         | 3.0   | 639  | 0.2699          | 0.5310    | 0.3411 | 0.4153 | 0.9434   |
+| Train Loss | Validation Loss | Train Precision | Train Recall | Train F1 | Train Accuracy | Epoch |
+|:----------:|:---------------:|:---------------:|:------------:|:--------:|:--------------:|:-----:|
+| 0.3233     | 0.3099          | 0.4155          | 0.2117       | 0.2805   | 0.9333         | 0     |
 
 
 ### Framework versions
 
 - Transformers 4.22.2
-- Pytorch 1.12.1+cu113
+- TensorFlow 2.8.2
 - Datasets 2.5.1
 - Tokenizers 0.12.1

config.json

@@ -48,7 +48,6 @@
   "seq_classif_dropout": 0.2,
   "sinusoidal_pos_embds": false,
   "tie_weights_": true,
-  "torch_dtype": "float32",
   "transformers_version": "4.22.2",
   "vocab_size": 30522
 }

tf_model.h5

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:9d09d6aaaf3f1cdae11cc3bec9be4c2b37de6bc816589862737768c7a9b3c362
+size 265618792

tokenizer.json

@@ -1,6 +1,11 @@
 {
   "version": "1.0",
-  "truncation": null,
+  "truncation": {
+    "direction": "Right",
+    "max_length": 512,
+    "strategy": "LongestFirst",
+    "stride": 0
+  },
   "padding": null,
   "added_tokens": [
     {

tokenizer_config.json

@@ -3,7 +3,7 @@
   "do_lower_case": true,
   "mask_token": "[MASK]",
   "model_max_length": 512,
-  "name_or_path": "stevhliu/my_awesome_wnut_model",
+  "name_or_path": "distilbert-base-uncased",
   "pad_token": "[PAD]",
   "sep_token": "[SEP]",
   "special_tokens_map_file": null,