End of training

README.md

@@ -1,5 +1,6 @@
 ---
 license: apache-2.0
+base_model: distilbert-base-uncased
 tags:
 - generated_from_trainer
 datasets:
@@ -10,7 +11,7 @@ metrics:
 - f1
 - accuracy
 model-index:
-- name: my_awesome_wnut_model
+- name: Bert-NER
   results:
   - task:
       name: Token Classification
@@ -24,30 +25,30 @@ model-index:
     metrics:
     - name: Precision
       type: precision
-      value: 1.0
+      value: 0.7254647322919372
     - name: Recall
       type: recall
-      value: 1.0
+      value: 0.8467001558981465
     - name: F1
       type: f1
-      value: 1.0
+      value: 0.7814079891293488
     - name: Accuracy
       type: accuracy
-      value: 1.0
+      value: 0.8557099199430039
 ---
 
 <!-- This model card has been generated automatically according to the information the Trainer had access to. You
 should probably proofread and complete it, then remove this comment. -->
 
-# my_awesome_wnut_model
+# Bert-NER
 
-This model is a fine-tuned version of [bert-base-cased](https://huggingface.co/bert-base-cased) on the ner dataset.
+This model is a fine-tuned version of [distilbert-base-uncased](https://huggingface.co/distilbert-base-uncased) on the ner dataset.
 It achieves the following results on the evaluation set:
-- Loss: 0.0000
-- Precision: 1.0
-- Recall: 1.0
-- F1: 1.0
-- Accuracy: 1.0
+- Loss: 0.9081
+- Precision: 0.7255
+- Recall: 0.8467
+- F1: 0.7814
+- Accuracy: 0.8557
 
 ## Model description
 
@@ -67,8 +68,8 @@ More information needed
 
 The following hyperparameters were used during training:
 - learning_rate: 5e-05
-- train_batch_size: 32
-- eval_batch_size: 32
+- train_batch_size: 16
+- eval_batch_size: 16
 - seed: 42
 - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
 - lr_scheduler_type: linear
@@ -78,16 +79,16 @@ The following hyperparameters were used during training:
 
 | Training Loss | Epoch | Step | Validation Loss | Precision | Recall | F1     | Accuracy |
 |:-------------:|:-----:|:----:|:---------------:|:---------:|:------:|:------:|:--------:|
-| No log        | 1.0   | 344  | 0.0003          | 1.0000    | 1.0000 | 1.0000 | 1.0000   |
-| 0.031         | 2.0   | 688  | 0.0002          | 1.0000    | 1.0000 | 1.0000 | 1.0000   |
-| 0.005         | 3.0   | 1032 | 0.0000          | 1.0       | 1.0    | 1.0    | 1.0      |
-| 0.005         | 4.0   | 1376 | 0.0000          | 1.0       | 1.0    | 1.0    | 1.0      |
-| 0.001         | 5.0   | 1720 | 0.0000          | 1.0       | 1.0    | 1.0    | 1.0      |
+| 0.0934        | 1.0   | 501  | 0.6938          | 0.7190    | 0.8536 | 0.7805 | 0.8502   |
+| 0.035         | 2.0   | 1002 | 0.7709          | 0.7087    | 0.8383 | 0.7681 | 0.8446   |
+| 0.0196        | 3.0   | 1503 | 0.7814          | 0.7130    | 0.8439 | 0.7729 | 0.8477   |
+| 0.0109        | 4.0   | 2004 | 0.8572          | 0.7206    | 0.8467 | 0.7786 | 0.8526   |
+| 0.0065        | 5.0   | 2505 | 0.9081          | 0.7255    | 0.8467 | 0.7814 | 0.8557   |
 
 
 ### Framework versions
 
-- Transformers 4.30.2
+- Transformers 4.33.2
 - Pytorch 2.0.1+cu118
-- Datasets 2.13.1
+- Datasets 2.14.5
 - Tokenizers 0.13.3

pytorch_model.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:47c6cbbcef4e5727827966da23f5f0b474e42d208033e03b061deb6f4819b587
+oid sha256:be94b5571ed9a7ab7a185c38244e14322695fefa936fd67e67840d5fc5a65692
 size 265501733