Hugging Face's logo

helling100
/
Regression_bert_1

Text Classification
Transformers
TensorFlow
distilbert
generated_from_keras_callback
Inference Endpoints
Model card Files Community
helling100 commited on
Commit
b5ce512
•
1 Parent(s): 387208f

Upload TFBertForSequenceClassification

Browse files
Files changed (3) hide show
  1. README.md +30 -30
  2. config.json +6 -2
  3. tf_model.h5 +2 -2
README.md CHANGED
@@ -14,16 +14,16 @@ probably proofread and complete it, then remove this comment. -->
14
 
15
  This model is a fine-tuned version of [bert-base-cased](https://huggingface.co/bert-base-cased) on an unknown dataset.
16
  It achieves the following results on the evaluation set:
17
- - Train Loss: 0.2489
18
- - Train Mae: 0.3355
19
- - Train Mse: 0.1670
20
- - Train R2-score: 0.5318
21
- - Train Accuracy: 0.5
22
- - Validation Loss: 0.2163
23
- - Validation Mae: 0.4087
24
- - Validation Mse: 0.2153
25
- - Validation R2-score: 0.8371
26
- - Validation Accuracy: 0.2703
27
  - Epoch: 19
28
 
29
  ## Model description
@@ -50,26 +50,26 @@ The following hyperparameters were used during training:
50
 
51
  | Train Loss | Train Mae | Train Mse | Train R2-score | Train Accuracy | Validation Loss | Validation Mae | Validation Mse | Validation R2-score | Validation Accuracy | Epoch |
52
  |:----------:|:---------:|:---------:|:--------------:|:--------------:|:---------------:|:--------------:|:--------------:|:-------------------:|:-------------------:|:-----:|
53
- | 0.2907 | 0.3158 | 0.1575 | 0.6537 | 0.5692 | 0.2087 | 0.3991 | 0.2076 | 0.8421 | 0.2703 | 0 |
54
- | 0.5109 | 0.3124 | 0.1437 | 0.7067 | 0.5538 | 0.2134 | 0.4051 | 0.2124 | 0.8390 | 0.2703 | 1 |
55
- | 0.3757 | 0.3131 | 0.1489 | 0.7306 | 0.5538 | 0.2138 | 0.4055 | 0.2127 | 0.8388 | 0.2703 | 2 |
56
- | 0.5703 | 0.3369 | 0.1733 | 0.6746 | 0.5385 | 0.2097 | 0.4004 | 0.2086 | 0.8414 | 0.2703 | 3 |
57
- | 0.3149 | 0.3314 | 0.1616 | 0.6958 | 0.5154 | 0.2090 | 0.3995 | 0.2079 | 0.8419 | 0.2703 | 4 |
58
- | 0.3633 | 0.3331 | 0.1653 | 0.6961 | 0.5154 | 0.2083 | 0.3986 | 0.2072 | 0.8423 | 0.2703 | 5 |
59
- | 0.2274 | 0.3384 | 0.1795 | 0.6844 | 0.5231 | 0.2075 | 0.3975 | 0.2064 | 0.8429 | 0.2703 | 6 |
60
- | 0.2552 | 0.3141 | 0.1496 | 0.4397 | 0.5615 | 0.2061 | 0.3957 | 0.2050 | 0.8438 | 0.2703 | 7 |
61
- | 0.2650 | 0.3459 | 0.1772 | 0.6305 | 0.4615 | 0.2043 | 0.3934 | 0.2032 | 0.8449 | 0.2703 | 8 |
62
- | 0.3674 | 0.3251 | 0.1647 | 0.6980 | 0.4923 | 0.2086 | 0.3990 | 0.2075 | 0.8421 | 0.2703 | 9 |
63
- | 0.4815 | 0.3122 | 0.1546 | 0.6067 | 0.5538 | 0.2078 | 0.3979 | 0.2067 | 0.8427 | 0.2703 | 10 |
64
- | 0.4321 | 0.3446 | 0.1783 | 0.6082 | 0.5308 | 0.2068 | 0.3966 | 0.2056 | 0.8433 | 0.2703 | 11 |
65
- | 0.3884 | 0.3257 | 0.1637 | 0.6823 | 0.5077 | 0.2038 | 0.3928 | 0.2027 | 0.8452 | 0.2703 | 12 |
66
- | 0.2694 | 0.3353 | 0.1719 | 0.6679 | 0.5385 | 0.2026 | 0.3912 | 0.2014 | 0.8460 | 0.2703 | 13 |
67
- | 0.3124 | 0.3223 | 0.1605 | 0.6018 | 0.5231 | 0.2067 | 0.3965 | 0.2055 | 0.8434 | 0.2703 | 14 |
68
- | 0.3527 | 0.3281 | 0.1645 | 0.5474 | 0.5462 | 0.2088 | 0.3992 | 0.2077 | 0.8420 | 0.2703 | 15 |
69
- | 0.3506 | 0.3452 | 0.1775 | 0.6449 | 0.5077 | 0.2120 | 0.4032 | 0.2109 | 0.8399 | 0.2703 | 16 |
70
- | 0.5240 | 0.3363 | 0.1683 | 0.6028 | 0.5077 | 0.2194 | 0.4124 | 0.2183 | 0.8351 | 0.2703 | 17 |
71
- | 0.2749 | 0.3272 | 0.1678 | 0.6595 | 0.5308 | 0.2191 | 0.4121 | 0.2181 | 0.8352 | 0.2703 | 18 |
72
- | 0.2489 | 0.3355 | 0.1670 | 0.5318 | 0.5 | 0.2163 | 0.4087 | 0.2153 | 0.8371 | 0.2703 | 19 |
73
 
74
 
75
  ### Framework versions
 
14
 
15
  This model is a fine-tuned version of [bert-base-cased](https://huggingface.co/bert-base-cased) on an unknown dataset.
16
  It achieves the following results on the evaluation set:
17
+ - Train Loss: 0.2391
18
+ - Train Mae: 0.3195
19
+ - Train Mse: 0.1560
20
+ - Train R2-score: 0.6527
21
+ - Train Accuracy: 0.7000
22
+ - Validation Loss: 0.2004
23
+ - Validation Mae: 0.3928
24
+ - Validation Mse: 0.1992
25
+ - Validation R2-score: 0.7864
26
+ - Validation Accuracy: 0.5045
27
  - Epoch: 19
28
 
29
  ## Model description
 
50
 
51
  | Train Loss | Train Mae | Train Mse | Train R2-score | Train Accuracy | Validation Loss | Validation Mae | Validation Mse | Validation R2-score | Validation Accuracy | Epoch |
52
  |:----------:|:---------:|:---------:|:--------------:|:--------------:|:---------------:|:--------------:|:--------------:|:-------------------:|:-------------------:|:-----:|
53
+ | 0.3059 | 0.3004 | 0.1391 | 0.2698 | 0.7615 | 0.1679 | 0.3612 | 0.1664 | 0.8226 | 0.7297 | 0 |
54
+ | 0.3078 | 0.3128 | 0.1536 | 0.5256 | 0.7333 | 0.1964 | 0.3883 | 0.1953 | 0.7905 | 0.5225 | 1 |
55
+ | 0.2835 | 0.3117 | 0.1453 | 0.6731 | 0.7436 | 0.1552 | 0.3466 | 0.1536 | 0.8344 | 0.9009 | 2 |
56
+ | 0.2894 | 0.2934 | 0.1319 | 0.5769 | 0.7872 | 0.1648 | 0.3593 | 0.1633 | 0.8246 | 0.7387 | 3 |
57
+ | 0.2968 | 0.3093 | 0.1457 | 0.6067 | 0.7590 | 0.1735 | 0.3612 | 0.1721 | 0.8169 | 0.7658 | 4 |
58
+ | 0.2352 | 0.3072 | 0.1469 | 0.4849 | 0.7385 | 0.1841 | 0.3698 | 0.1828 | 0.8045 | 0.6757 | 5 |
59
+ | 0.2289 | 0.3087 | 0.1453 | 0.5043 | 0.7513 | 0.1505 | 0.3435 | 0.1488 | 0.8395 | 0.9369 | 6 |
60
+ | 0.3171 | 0.2925 | 0.1307 | 0.6744 | 0.7949 | 0.1885 | 0.3742 | 0.1873 | 0.7988 | 0.5315 | 7 |
61
+ | 0.3035 | 0.2992 | 0.1367 | 0.5324 | 0.7538 | 0.1655 | 0.3536 | 0.1640 | 0.8240 | 0.8559 | 8 |
62
+ | 0.2230 | 0.3118 | 0.1506 | 0.6671 | 0.7154 | 0.1699 | 0.3573 | 0.1685 | 0.8197 | 0.7838 | 9 |
63
+ | 0.2696 | 0.3023 | 0.1446 | 0.3957 | 0.7308 | 0.1795 | 0.3697 | 0.1781 | 0.8092 | 0.7207 | 10 |
64
+ | 0.3948 | 0.3093 | 0.1457 | 0.6762 | 0.7385 | 0.1685 | 0.3593 | 0.1670 | 0.8189 | 0.7207 | 11 |
65
+ | 0.3111 | 0.3081 | 0.1456 | 0.6799 | 0.7205 | 0.2205 | 0.4121 | 0.2195 | 0.7623 | 0.4955 | 12 |
66
+ | 0.3261 | 0.3255 | 0.1638 | 0.4975 | 0.6974 | 0.1668 | 0.3542 | 0.1653 | 0.8229 | 0.9279 | 13 |
67
+ | 0.2362 | 0.2918 | 0.1294 | 0.6853 | 0.8026 | 0.1577 | 0.3525 | 0.1561 | 0.8317 | 0.7387 | 14 |
68
+ | 0.3563 | 0.3067 | 0.1461 | 0.5645 | 0.7256 | 0.2071 | 0.3959 | 0.2059 | 0.7812 | 0.3694 | 15 |
69
+ | 0.2664 | 0.3261 | 0.1659 | 0.5289 | 0.6641 | 0.1852 | 0.3706 | 0.1839 | 0.8049 | 0.6937 | 16 |
70
+ | 0.2194 | 0.2982 | 0.1387 | 0.6153 | 0.7513 | 0.1685 | 0.3569 | 0.1671 | 0.8220 | 0.7928 | 17 |
71
+ | 0.3482 | 0.3021 | 0.1380 | 0.5936 | 0.7590 | 0.2050 | 0.3943 | 0.2039 | 0.7821 | 0.4775 | 18 |
72
+ | 0.2391 | 0.3195 | 0.1560 | 0.6527 | 0.7000 | 0.2004 | 0.3928 | 0.1992 | 0.7864 | 0.5045 | 19 |
73
 
74
 
75
  ### Framework versions
config.json CHANGED
@@ -10,12 +10,16 @@
10
  "hidden_dropout_prob": 0.1,
11
  "hidden_size": 768,
12
  "id2label": {
13
- "0": "LABEL_0"
 
 
14
  },
15
  "initializer_range": 0.02,
16
  "intermediate_size": 3072,
17
  "label2id": {
18
- "LABEL_0": 0
 
 
19
  },
20
  "layer_norm_eps": 1e-12,
21
  "max_position_embeddings": 512,
 
10
  "hidden_dropout_prob": 0.1,
11
  "hidden_size": 768,
12
  "id2label": {
13
+ "0": "LABEL_0",
14
+ "1": "LABEL_1",
15
+ "2": "LABEL_2"
16
  },
17
  "initializer_range": 0.02,
18
  "intermediate_size": 3072,
19
  "label2id": {
20
+ "LABEL_0": 0,
21
+ "LABEL_1": 1,
22
+ "LABEL_2": 2
23
  },
24
  "layer_norm_eps": 1e-12,
25
  "max_position_embeddings": 512,
tf_model.h5 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:52dee4962f46730eb59668a2116ca2319fc2d92e489f7a2e093bc0e13c2fcd32
3
- size 433532180
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7287079d6577636ca6b9e0deafa5babf515088f3d9f04789de7fef4669d5ddd6
3
+ size 433538332