File size: 2,224 Bytes
e318d5f
a69b497
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
e318d5f
 
a69b497
 
e318d5f
a69b497
e318d5f
a69b497
 
 
 
 
 
 
e318d5f
a69b497
e318d5f
a69b497
e318d5f
a69b497
e318d5f
a69b497
e318d5f
a69b497
e318d5f
a69b497
e318d5f
a69b497
e318d5f
a69b497
e318d5f
a69b497
 
 
 
 
 
 
 
e318d5f
a69b497
e318d5f
a69b497
 
 
 
 
e318d5f
 
a69b497
e318d5f
a69b497
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
---
license: apache-2.0
base_model: bert-base-cased
tags:
- generated_from_trainer
datasets:
- conll2003
metrics:
- precision
- recall
- f1
- accuracy
model-index:
- name: bert-finetuned-ner4
  results:
  - task:
      name: Token Classification
      type: token-classification
    dataset:
      name: conll2003
      type: conll2003
      config: conll2003
      split: validation
      args: conll2003
    metrics:
    - name: Precision
      type: precision
      value: 0.9370548285572304
    - name: Recall
      type: recall
      value: 0.9520363513968361
    - name: F1
      type: f1
      value: 0.9444861841556057
    - name: Accuracy
      type: accuracy
      value: 0.9864749514334491
---

<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->

# bert-finetuned-ner4

This model is a fine-tuned version of [bert-base-cased](https://huggingface.co/bert-base-cased) on the conll2003 dataset.
It achieves the following results on the evaluation set:
- Loss: 0.0615
- Precision: 0.9371
- Recall: 0.9520
- F1: 0.9445
- Accuracy: 0.9865

## Model description

More information needed

## Intended uses & limitations

More information needed

## Training and evaluation data

More information needed

## Training procedure

### Training hyperparameters

The following hyperparameters were used during training:
- learning_rate: 2e-05
- train_batch_size: 8
- eval_batch_size: 8
- seed: 42
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- num_epochs: 3

### Training results

| Training Loss | Epoch | Step | Validation Loss | Precision | Recall | F1     | Accuracy |
|:-------------:|:-----:|:----:|:---------------:|:---------:|:------:|:------:|:--------:|
| 0.0761        | 1.0   | 1756 | 0.0665          | 0.8962    | 0.9329 | 0.9142 | 0.9811   |
| 0.0343        | 2.0   | 3512 | 0.0646          | 0.9318    | 0.9475 | 0.9396 | 0.9855   |
| 0.0218        | 3.0   | 5268 | 0.0615          | 0.9371    | 0.9520 | 0.9445 | 0.9865   |


### Framework versions

- Transformers 4.41.1
- Pytorch 2.3.0+cu121
- Datasets 2.19.2
- Tokenizers 0.19.1