HuggingAlex1247 commited on
Commit
a909d42
1 Parent(s): ec39ed9

Upload README.md

Browse files
Files changed (1) hide show
  1. README.md +46 -30
README.md CHANGED
@@ -1,22 +1,50 @@
1
  ---
 
 
2
  license: mit
3
- tags:
4
- - generated_from_keras_callback
 
 
 
 
 
5
  model-index:
6
- - name: HuggingAlex1247/distilbert-base-german-europeana-cased-germeval_14
7
- results: []
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
8
  ---
9
 
10
- <!-- This model card has been generated automatically according to the information Keras had access to. You should
11
- probably proofread and complete it, then remove this comment. -->
12
 
13
- # HuggingAlex1247/distilbert-base-german-europeana-cased-germeval_14
14
 
15
- This model is a fine-tuned version of [dbmdz/distilbert-base-german-europeana-cased](https://huggingface.co/dbmdz/distilbert-base-german-europeana-cased) on an unknown dataset.
16
  It achieves the following results on the evaluation set:
17
- - Train Loss: 0.0433
18
- - Validation Loss: 0.1874
19
- - Epoch: 9
 
20
 
21
  ## Model description
22
 
@@ -35,28 +63,16 @@ More information needed
35
  ### Training hyperparameters
36
 
37
  The following hyperparameters were used during training:
38
- - optimizer: {'name': 'AdamWeightDecay', 'learning_rate': {'class_name': 'PolynomialDecay', 'config': {'initial_learning_rate': 1e-05, 'decay_steps': 25500, 'end_learning_rate': 0.0, 'power': 1.0, 'cycle': False, 'name': None}}, 'decay': 0.0, 'beta_1': 0.9, 'beta_2': 0.999, 'epsilon': 1e-08, 'amsgrad': False, 'weight_decay_rate': 0.01}
39
- - training_precision: float32
40
-
41
- ### Training results
42
-
43
- | Train Loss | Validation Loss | Epoch |
44
- |:----------:|:---------------:|:-----:|
45
- | 0.3609 | 0.2115 | 0 |
46
- | 0.1889 | 0.1810 | 1 |
47
- | 0.1430 | 0.1729 | 2 |
48
- | 0.1115 | 0.1647 | 3 |
49
- | 0.0887 | 0.1715 | 4 |
50
- | 0.0726 | 0.1754 | 5 |
51
- | 0.0607 | 0.1790 | 6 |
52
- | 0.0528 | 0.1838 | 7 |
53
- | 0.0473 | 0.1853 | 8 |
54
- | 0.0433 | 0.1874 | 9 |
55
-
56
 
57
  ### Framework versions
58
 
59
  - Transformers 4.17.0
60
- - TensorFlow 2.6.2
61
  - Datasets 1.18.0
62
  - Tokenizers 0.11.6
1
  ---
2
+ language:
3
+ - de
4
  license: mit
5
+ datasets:
6
+ - germeval_14
7
+ metrics:
8
+ - precision
9
+ - recall
10
+ - f1
11
+ - accuracy
12
  model-index:
13
+ - name: distilbert-base-german-europeana-cased-germeval_14
14
+ results:
15
+ - task:
16
+ name: Token Classification
17
+ type: token-classification
18
+ dataset:
19
+ name: germeval_14
20
+ type: germeval_14
21
+ args: default
22
+ metrics:
23
+ - name: precision
24
+ type: precision
25
+ value: 0.7437097717963721
26
+ - name: recall
27
+ type: recall
28
+ value: 0.7571485305798252
29
+ - name: f1
30
+ type: f1
31
+ value: 0.7503689855357669
32
+ - name: accuracy
33
+ type: accuracy
34
+ value: 0.9541357066185896
35
  ---
36
 
37
+ <!-- This model card has been generated automatically according to the information the Trainer had access to. You
38
+ should probably proofread and complete it, then remove this comment. -->
39
 
40
+ # distilbert-base-german-europeana-cased-germeval_14
41
 
42
+ This model is a fine-tuned version of [dbmdz/distilbert-base-german-europeana-cased](https://huggingface.co/dbmdz/distilbert-base-german-europeana-cased) on the germeval_14 dataset.
43
  It achieves the following results on the evaluation set:
44
+ - precision: 0.7437
45
+ - recall: 0.7571
46
+ - f1: 0.7504
47
+ - accuracy: 0.9541
48
 
49
  ## Model description
50
 
63
  ### Training hyperparameters
64
 
65
  The following hyperparameters were used during training:
66
+ - num_train_epochs: 10
67
+ - train_batch_size: 8
68
+ - eval_batch_size: 8
69
+ - learning_rate: 1e-05
70
+ - weight_decay_rate: 0.01
71
+ - num_warmup_steps: 0
72
+ - fp16: True
 
 
 
 
 
 
 
 
 
 
 
73
 
74
  ### Framework versions
75
 
76
  - Transformers 4.17.0
 
77
  - Datasets 1.18.0
78
  - Tokenizers 0.11.6