Pyjay commited on
Commit
339dcc5
1 Parent(s): 116be00
.gitignore ADDED
@@ -0,0 +1 @@
 
 
1
+ checkpoint-*/
README.md ADDED
@@ -0,0 +1,60 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ tags:
3
+ - generated_from_trainer
4
+ model_index:
5
+ - name: bert-base-dutch-cased-finetuned-gv
6
+ results:
7
+ - task:
8
+ name: Masked Language Modeling
9
+ type: fill-mask
10
+ ---
11
+
12
+ <!-- This model card has been generated automatically according to the information the Trainer had access to. You
13
+ should probably proofread and complete it, then remove this comment. -->
14
+
15
+ # bert-base-dutch-cased-finetuned-gv
16
+
17
+ This model is a fine-tuned version of [GroNLP/bert-base-dutch-cased](https://huggingface.co/GroNLP/bert-base-dutch-cased) on an unkown dataset.
18
+ It achieves the following results on the evaluation set:
19
+ - Loss: 1.7815
20
+
21
+ ## Model description
22
+
23
+ More information needed
24
+
25
+ ## Intended uses & limitations
26
+
27
+ More information needed
28
+
29
+ ## Training and evaluation data
30
+
31
+ More information needed
32
+
33
+ ## Training procedure
34
+
35
+ ### Training hyperparameters
36
+
37
+ The following hyperparameters were used during training:
38
+ - learning_rate: 2e-05
39
+ - train_batch_size: 8
40
+ - eval_batch_size: 8
41
+ - seed: 42
42
+ - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
43
+ - lr_scheduler_type: linear
44
+ - num_epochs: 3.0
45
+
46
+ ### Training results
47
+
48
+ | Training Loss | Epoch | Step | Validation Loss |
49
+ |:-------------:|:-----:|:-----:|:---------------:|
50
+ | 1.1796 | 1.0 | 9156 | 1.8492 |
51
+ | 0.9396 | 2.0 | 18312 | 1.8198 |
52
+ | 0.9073 | 3.0 | 27468 | 1.7815 |
53
+
54
+
55
+ ### Framework versions
56
+
57
+ - Transformers 4.8.2
58
+ - Pytorch 1.9.0+cu102
59
+ - Datasets 1.9.0
60
+ - Tokenizers 0.10.3
config.json ADDED
@@ -0,0 +1,24 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "_name_or_path": "GroNLP/bert-base-dutch-cased",
3
+ "architectures": [
4
+ "BertForMaskedLM"
5
+ ],
6
+ "attention_probs_dropout_prob": 0.1,
7
+ "gradient_checkpointing": false,
8
+ "hidden_act": "gelu",
9
+ "hidden_dropout_prob": 0.1,
10
+ "hidden_size": 768,
11
+ "initializer_range": 0.02,
12
+ "intermediate_size": 3072,
13
+ "layer_norm_eps": 1e-12,
14
+ "max_position_embeddings": 512,
15
+ "model_type": "bert",
16
+ "num_attention_heads": 12,
17
+ "num_hidden_layers": 12,
18
+ "pad_token_id": 3,
19
+ "position_embedding_type": "absolute",
20
+ "transformers_version": "4.8.2",
21
+ "type_vocab_size": 2,
22
+ "use_cache": true,
23
+ "vocab_size": 30073
24
+ }
pytorch_model.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3dde3208a77b25b318be8d9c5eec474c9d7a2b03bff886275b5f514704aafbd2
3
+ size 436760875
runs/Jul12_15-34-47_9b16f17f9c91/1626104107.5060039/events.out.tfevents.1626104107.9b16f17f9c91.77.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4301f5d2621956365c000549c763f0f8bda3b4c3aea557df5d58e75d28d0d488
3
+ size 4198
runs/Jul12_15-34-47_9b16f17f9c91/events.out.tfevents.1626104107.9b16f17f9c91.77.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:896fa2b9fbb5f302a6e0b773e9510bfb7a3ec5e4d074933e2fe47402d096ac71
3
+ size 8341
runs/Jul12_16-30-17_9b16f17f9c91/1626107427.4946554/events.out.tfevents.1626107427.9b16f17f9c91.1445.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6dd998ba1aaec43f3cbe3a2a671ad689381e46fb89a882a3175ff70fc6439eaf
3
+ size 4198
runs/Jul12_16-30-17_9b16f17f9c91/events.out.tfevents.1626107427.9b16f17f9c91.1445.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a3e8c252423902a8b64d6ea616c2483c237ad27279b9808b75ef2e567d335c27
3
+ size 12662
training_args.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fd4de531cef781a2119db8270b4d2d1f04c8a38ab2aa2af80db32777247c0d6d
3
+ size 2671