Luciano commited on
Commit
9cc939f
1 Parent(s): 58ab33c

Commit using trainer.push_to_hub()

Browse files
.gitignore ADDED
@@ -0,0 +1 @@
 
1
+ checkpoint-*/
README.md ADDED
@@ -0,0 +1,78 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: mit
3
+ tags:
4
+ - generated_from_trainer
5
+ datasets:
6
+ - lener_br
7
+ metrics:
8
+ - precision
9
+ - recall
10
+ - f1
11
+ - accuracy
12
+ model_index:
13
+ - name: bertimbau-large-lener_br
14
+ results:
15
+ - task:
16
+ name: Token Classification
17
+ type: token-classification
18
+ dataset:
19
+ name: lener_br
20
+ type: lener_br
21
+ args: lener_br
22
+ metric:
23
+ name: Accuracy
24
+ type: accuracy
25
+ value: 0.9680466881009341
26
+ ---
27
+
28
+ <!-- This model card has been generated automatically according to the information the Trainer had access to. You
29
+ should probably proofread and complete it, then remove this comment. -->
30
+
31
+ # bertimbau-large-lener_br
32
+
33
+ This model is a fine-tuned version of [neuralmind/bert-large-portuguese-cased](https://huggingface.co/neuralmind/bert-large-portuguese-cased) on the lener_br dataset.
34
+ It achieves the following results on the evaluation set:
35
+ - Loss: 0.1212
36
+ - Precision: 0.8574
37
+ - Recall: 0.8925
38
+ - F1: 0.8746
39
+ - Accuracy: 0.9680
40
+
41
+ ## Model description
42
+
43
+ More information needed
44
+
45
+ ## Intended uses & limitations
46
+
47
+ More information needed
48
+
49
+ ## Training and evaluation data
50
+
51
+ More information needed
52
+
53
+ ## Training procedure
54
+
55
+ ### Training hyperparameters
56
+
57
+ The following hyperparameters were used during training:
58
+ - learning_rate: 2e-05
59
+ - train_batch_size: 4
60
+ - eval_batch_size: 4
61
+ - seed: 42
62
+ - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
63
+ - lr_scheduler_type: linear
64
+ - num_epochs: 1
65
+
66
+ ### Training results
67
+
68
+ | Training Loss | Epoch | Step | Validation Loss | Precision | Recall | F1 | Accuracy |
69
+ |:-------------:|:-----:|:----:|:---------------:|:---------:|:------:|:------:|:--------:|
70
+ | 0.0569 | 1.0 | 1957 | 0.1212 | 0.8574 | 0.8925 | 0.8746 | 0.9680 |
71
+
72
+
73
+ ### Framework versions
74
+
75
+ - Transformers 4.8.2
76
+ - Pytorch 1.9.0+cu102
77
+ - Datasets 1.9.0
78
+ - Tokenizers 0.10.3
config.json ADDED
@@ -0,0 +1,61 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "_name_or_path": "neuralmind/bert-large-portuguese-cased",
3
+ "architectures": [
4
+ "BertForTokenClassification"
5
+ ],
6
+ "attention_probs_dropout_prob": 0.1,
7
+ "directionality": "bidi",
8
+ "gradient_checkpointing": false,
9
+ "hidden_act": "gelu",
10
+ "hidden_dropout_prob": 0.1,
11
+ "hidden_size": 1024,
12
+ "id2label": {
13
+ "0": "O",
14
+ "1": "B-ORGANIZACAO",
15
+ "2": "I-ORGANIZACAO",
16
+ "3": "B-PESSOA",
17
+ "4": "I-PESSOA",
18
+ "5": "B-TEMPO",
19
+ "6": "I-TEMPO",
20
+ "7": "B-LOCAL",
21
+ "8": "I-LOCAL",
22
+ "9": "B-LEGISLACAO",
23
+ "10": "I-LEGISLACAO",
24
+ "11": "B-JURISPRUDENCIA",
25
+ "12": "I-JURISPRUDENCIA"
26
+ },
27
+ "initializer_range": 0.02,
28
+ "intermediate_size": 4096,
29
+ "label2id": {
30
+ "B-JURISPRUDENCIA": 11,
31
+ "B-LEGISLACAO": 9,
32
+ "B-LOCAL": 7,
33
+ "B-ORGANIZACAO": 1,
34
+ "B-PESSOA": 3,
35
+ "B-TEMPO": 5,
36
+ "I-JURISPRUDENCIA": 12,
37
+ "I-LEGISLACAO": 10,
38
+ "I-LOCAL": 8,
39
+ "I-ORGANIZACAO": 2,
40
+ "I-PESSOA": 4,
41
+ "I-TEMPO": 6,
42
+ "O": 0
43
+ },
44
+ "layer_norm_eps": 1e-12,
45
+ "max_position_embeddings": 512,
46
+ "model_type": "bert",
47
+ "num_attention_heads": 16,
48
+ "num_hidden_layers": 24,
49
+ "output_past": true,
50
+ "pad_token_id": 0,
51
+ "pooler_fc_size": 768,
52
+ "pooler_num_attention_heads": 12,
53
+ "pooler_num_fc_layers": 3,
54
+ "pooler_size_per_head": 128,
55
+ "pooler_type": "first_token_transform",
56
+ "position_embedding_type": "absolute",
57
+ "transformers_version": "4.8.2",
58
+ "type_vocab_size": 2,
59
+ "use_cache": true,
60
+ "vocab_size": 29794
61
+ }
pytorch_model.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:494ecc3959bc3c092d27448c08e3e8174592e942cc58b3fa94d2416ca3299187
3
+ size 1333601457
runs/Jul07_10-59-01_6a45b909fa50/1625655551.0282962/events.out.tfevents.1625655551.6a45b909fa50.78.1 ADDED
Binary file (4.24 kB). View file
runs/Jul07_10-59-01_6a45b909fa50/events.out.tfevents.1625655551.6a45b909fa50.78.0 ADDED
Binary file (5.1 kB). View file
runs/Jul07_10-59-01_6a45b909fa50/events.out.tfevents.1625656088.6a45b909fa50.78.2 ADDED
Binary file (512 Bytes). View file
special_tokens_map.json ADDED
@@ -0,0 +1 @@
 
1
+ {"unk_token": "[UNK]", "sep_token": "[SEP]", "pad_token": "[PAD]", "cls_token": "[CLS]", "mask_token": "[MASK]"}
tokenizer.json ADDED
The diff for this file is too large to render. See raw diff
tokenizer_config.json ADDED
@@ -0,0 +1 @@
 
1
+ {"do_lower_case": false, "unk_token": "[UNK]", "sep_token": "[SEP]", "pad_token": "[PAD]", "cls_token": "[CLS]", "mask_token": "[MASK]", "tokenize_chinese_chars": true, "strip_accents": null, "model_max_length": 512, "special_tokens_map_file": "/root/.cache/huggingface/transformers/d5b721c156180bbbcc4a1017e8c72a18f8f96cdc178acec5ddcd45905712b4cf.dd8bd9bfd3664b530ea4e645105f557769387b3da9f79bdb55ed556bdd80611d", "name_or_path": "neuralmind/bert-large-portuguese-cased", "do_basic_tokenize": true, "never_split": null, "tokenizer_class": "BertTokenizer"}
training_args.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ab4bb7f1cd452930d28253762e8e5de81589166907b08df5ce774141cea76b0c
3
+ size 2671
vocab.txt ADDED
The diff for this file is too large to render. See raw diff