audreyvasconcelos commited on
Commit
7e28257
1 Parent(s): 9d0ad27

End of training

Browse files
README.md ADDED
@@ -0,0 +1,64 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: mit
3
+ base_model: roberta-base
4
+ tags:
5
+ - generated_from_trainer
6
+ datasets:
7
+ - told-br
8
+ model-index:
9
+ - name: iag-class-ptbr
10
+ results: []
11
+ ---
12
+
13
+ <!-- This model card has been generated automatically according to the information the Trainer had access to. You
14
+ should probably proofread and complete it, then remove this comment. -->
15
+
16
+ # iag-class-ptbr
17
+
18
+ This model is a fine-tuned version of [roberta-base](https://huggingface.co/roberta-base) on the told-br dataset.
19
+ It achieves the following results on the evaluation set:
20
+ - Loss: 0.5147
21
+
22
+ ## Model description
23
+
24
+ More information needed
25
+
26
+ ## Intended uses & limitations
27
+
28
+ More information needed
29
+
30
+ ## Training and evaluation data
31
+
32
+ More information needed
33
+
34
+ ## Training procedure
35
+
36
+ ### Training hyperparameters
37
+
38
+ The following hyperparameters were used during training:
39
+ - learning_rate: 1e-05
40
+ - train_batch_size: 8
41
+ - eval_batch_size: 8
42
+ - seed: 42
43
+ - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
44
+ - lr_scheduler_type: linear
45
+ - lr_scheduler_warmup_steps: 500
46
+ - num_epochs: 5
47
+
48
+ ### Training results
49
+
50
+ | Training Loss | Epoch | Step | Validation Loss |
51
+ |:-------------:|:-----:|:-----:|:---------------:|
52
+ | 0.5936 | 1.0 | 2100 | 0.5406 |
53
+ | 0.4858 | 2.0 | 4200 | 0.5394 |
54
+ | 0.5622 | 3.0 | 6300 | 0.5147 |
55
+ | 0.4538 | 4.0 | 8400 | 0.5310 |
56
+ | 0.4305 | 5.0 | 10500 | 0.5799 |
57
+
58
+
59
+ ### Framework versions
60
+
61
+ - Transformers 4.31.0
62
+ - Pytorch 2.0.1+cu118
63
+ - Datasets 2.14.4
64
+ - Tokenizers 0.13.3
logs/events.out.tfevents.1692617473.1e5e9e983fa3.1454.1 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:ffe30e207628ff1575d916f5f47fe931e5abbd1dce7679792460e6605fe7a553
3
- size 170372
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f5bfb348aaae42d444dc9f264cd5c75111b29fc76fe750d50bb7b217a7dc1984
3
+ size 170726
logs/events.out.tfevents.1692621998.1e5e9e983fa3.1454.2 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:410acd287df58653ac51c70acfedd6758a79845e260bf02ba36a6a7943c1dab3
3
+ size 359
merges.txt ADDED
The diff for this file is too large to render. See raw diff
 
pytorch_model.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:998a9e801797d3a32e84a39bf135e6c74e34728a31a1498c12b57e50855bac94
3
  size 498657649
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a304ce25e8863c01b5a938f7ad30705de3cb4f405fe1fa7136c89198d3bc524c
3
  size 498657649
special_tokens_map.json ADDED
@@ -0,0 +1,15 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "bos_token": "<s>",
3
+ "cls_token": "<s>",
4
+ "eos_token": "</s>",
5
+ "mask_token": {
6
+ "content": "<mask>",
7
+ "lstrip": true,
8
+ "normalized": false,
9
+ "rstrip": false,
10
+ "single_word": false
11
+ },
12
+ "pad_token": "<pad>",
13
+ "sep_token": "</s>",
14
+ "unk_token": "<unk>"
15
+ }
tokenizer.json ADDED
The diff for this file is too large to render. See raw diff
 
tokenizer_config.json ADDED
@@ -0,0 +1,15 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "add_prefix_space": false,
3
+ "bos_token": "<s>",
4
+ "clean_up_tokenization_spaces": true,
5
+ "cls_token": "<s>",
6
+ "eos_token": "</s>",
7
+ "errors": "replace",
8
+ "mask_token": "<mask>",
9
+ "model_max_length": 512,
10
+ "pad_token": "<pad>",
11
+ "sep_token": "</s>",
12
+ "tokenizer_class": "RobertaTokenizer",
13
+ "trim_offsets": true,
14
+ "unk_token": "<unk>"
15
+ }
vocab.json ADDED
The diff for this file is too large to render. See raw diff