tr-aravindan commited on
Commit
601ae55
1 Parent(s): 9e7ca0a

Training complete

Browse files
Files changed (1) hide show
  1. README.md +31 -19
README.md CHANGED
@@ -2,22 +2,29 @@
2
  license: apache-2.0
3
  base_model: bert-base-cased
4
  tags:
5
- - generated_from_keras_callback
 
 
 
 
 
6
  model-index:
7
- - name: tr-aravindan/bert-finetuned-ner
8
  results: []
9
  ---
10
 
11
- <!-- This model card has been generated automatically according to the information Keras had access to. You should
12
- probably proofread and complete it, then remove this comment. -->
13
 
14
- # tr-aravindan/bert-finetuned-ner
15
 
16
  This model is a fine-tuned version of [bert-base-cased](https://huggingface.co/bert-base-cased) on an unknown dataset.
17
  It achieves the following results on the evaluation set:
18
- - Train Loss: 0.0266
19
- - Validation Loss: 0.0531
20
- - Epoch: 2
 
 
21
 
22
  ## Model description
23
 
@@ -36,21 +43,26 @@ More information needed
36
  ### Training hyperparameters
37
 
38
  The following hyperparameters were used during training:
39
- - optimizer: {'name': 'AdamWeightDecay', 'learning_rate': {'module': 'keras.optimizers.schedules', 'class_name': 'PolynomialDecay', 'config': {'initial_learning_rate': 2e-05, 'decay_steps': 2634, 'end_learning_rate': 0.0, 'power': 1.0, 'cycle': False, 'name': None}, 'registered_name': None}, 'decay': 0.0, 'beta_1': 0.9, 'beta_2': 0.999, 'epsilon': 1e-08, 'amsgrad': False, 'weight_decay_rate': 0.01}
40
- - training_precision: mixed_float16
 
 
 
 
 
41
 
42
  ### Training results
43
 
44
- | Train Loss | Validation Loss | Epoch |
45
- |:----------:|:---------------:|:-----:|
46
- | 0.1673 | 0.0670 | 0 |
47
- | 0.0460 | 0.0563 | 1 |
48
- | 0.0266 | 0.0531 | 2 |
49
 
50
 
51
  ### Framework versions
52
 
53
- - Transformers 4.35.0
54
- - TensorFlow 2.14.0
55
- - Datasets 2.14.6
56
- - Tokenizers 0.14.1
 
2
  license: apache-2.0
3
  base_model: bert-base-cased
4
  tags:
5
+ - generated_from_trainer
6
+ metrics:
7
+ - precision
8
+ - recall
9
+ - f1
10
+ - accuracy
11
  model-index:
12
+ - name: bert-finetuned-ner
13
  results: []
14
  ---
15
 
16
+ <!-- This model card has been generated automatically according to the information the Trainer had access to. You
17
+ should probably proofread and complete it, then remove this comment. -->
18
 
19
+ # bert-finetuned-ner
20
 
21
  This model is a fine-tuned version of [bert-base-cased](https://huggingface.co/bert-base-cased) on an unknown dataset.
22
  It achieves the following results on the evaluation set:
23
+ - Loss: 0.0585
24
+ - Precision: 0.9362
25
+ - Recall: 0.9509
26
+ - F1: 0.9435
27
+ - Accuracy: 0.9864
28
 
29
  ## Model description
30
 
 
43
  ### Training hyperparameters
44
 
45
  The following hyperparameters were used during training:
46
+ - learning_rate: 2e-05
47
+ - train_batch_size: 8
48
+ - eval_batch_size: 8
49
+ - seed: 42
50
+ - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
51
+ - lr_scheduler_type: linear
52
+ - num_epochs: 3
53
 
54
  ### Training results
55
 
56
+ | Training Loss | Epoch | Step | Validation Loss | Precision | Recall | F1 | Accuracy |
57
+ |:-------------:|:-----:|:----:|:---------------:|:---------:|:------:|:------:|:--------:|
58
+ | 0.0799 | 1.0 | 1756 | 0.0809 | 0.9092 | 0.9332 | 0.9210 | 0.9789 |
59
+ | 0.0402 | 2.0 | 3512 | 0.0574 | 0.9263 | 0.9473 | 0.9367 | 0.9858 |
60
+ | 0.0255 | 3.0 | 5268 | 0.0585 | 0.9362 | 0.9509 | 0.9435 | 0.9864 |
61
 
62
 
63
  ### Framework versions
64
 
65
+ - Transformers 4.37.2
66
+ - Pytorch 2.1.0+cu121
67
+ - Datasets 2.16.1
68
+ - Tokenizers 0.15.1