Commit
•
83fb4b8
1
Parent(s):
e92cfff
update model card README.md
Browse files
README.md
CHANGED
@@ -14,7 +14,7 @@ should probably proofread and complete it, then remove this comment. -->
|
|
14 |
|
15 |
This model is a fine-tuned version of [bert-base-cased](https://huggingface.co/bert-base-cased) on the None dataset.
|
16 |
It achieves the following results on the evaluation set:
|
17 |
-
- Loss:
|
18 |
|
19 |
## Model description
|
20 |
|
@@ -39,42 +39,112 @@ The following hyperparameters were used during training:
|
|
39 |
- seed: 42
|
40 |
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
|
41 |
- lr_scheduler_type: linear
|
42 |
-
- num_epochs:
|
43 |
|
44 |
### Training results
|
45 |
|
46 |
| Training Loss | Epoch | Step | Validation Loss |
|
47 |
|:-------------:|:-----:|:----:|:---------------:|
|
48 |
-
| No log | 1.0 |
|
49 |
-
| No log | 2.0 |
|
50 |
-
| No log | 3.0 |
|
51 |
-
| No log | 4.0 |
|
52 |
-
| No log | 5.0 |
|
53 |
-
| No log | 6.0 |
|
54 |
-
| No log | 7.0 |
|
55 |
-
| 8.
|
56 |
-
| 8.
|
57 |
-
| 8.
|
58 |
-
| 8.
|
59 |
-
| 8.
|
60 |
-
| 8.
|
61 |
-
| 8.
|
62 |
-
| 7.
|
63 |
-
| 7.
|
64 |
-
| 7.
|
65 |
-
| 7.
|
66 |
-
| 7.
|
67 |
-
| 7.
|
68 |
-
| 7.
|
69 |
-
| 6.
|
70 |
-
| 6.
|
71 |
-
| 6.
|
72 |
-
| 6.
|
73 |
-
| 6.
|
74 |
-
| 6.
|
75 |
-
| 6.
|
76 |
-
|
|
77 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
78 |
|
79 |
|
80 |
### Framework versions
|
|
|
14 |
|
15 |
This model is a fine-tuned version of [bert-base-cased](https://huggingface.co/bert-base-cased) on the None dataset.
|
16 |
It achieves the following results on the evaluation set:
|
17 |
+
- Loss: 1.9029
|
18 |
|
19 |
## Model description
|
20 |
|
|
|
39 |
- seed: 42
|
40 |
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
|
41 |
- lr_scheduler_type: linear
|
42 |
+
- num_epochs: 100
|
43 |
|
44 |
### Training results
|
45 |
|
46 |
| Training Loss | Epoch | Step | Validation Loss |
|
47 |
|:-------------:|:-----:|:----:|:---------------:|
|
48 |
+
| No log | 1.0 | 71 | 8.8951 |
|
49 |
+
| No log | 2.0 | 142 | 8.8532 |
|
50 |
+
| No log | 3.0 | 213 | 8.7305 |
|
51 |
+
| No log | 4.0 | 284 | 8.5186 |
|
52 |
+
| No log | 5.0 | 355 | 8.3212 |
|
53 |
+
| No log | 6.0 | 426 | 8.1309 |
|
54 |
+
| No log | 7.0 | 497 | 7.9420 |
|
55 |
+
| 8.6328 | 8.0 | 568 | 7.7689 |
|
56 |
+
| 8.6328 | 9.0 | 639 | 7.6050 |
|
57 |
+
| 8.6328 | 10.0 | 710 | 7.4483 |
|
58 |
+
| 8.6328 | 11.0 | 781 | 7.2902 |
|
59 |
+
| 8.6328 | 12.0 | 852 | 7.1421 |
|
60 |
+
| 8.6328 | 13.0 | 923 | 6.9918 |
|
61 |
+
| 8.6328 | 14.0 | 994 | 6.8501 |
|
62 |
+
| 7.5715 | 15.0 | 1065 | 6.7115 |
|
63 |
+
| 7.5715 | 16.0 | 1136 | 6.5774 |
|
64 |
+
| 7.5715 | 17.0 | 1207 | 6.4431 |
|
65 |
+
| 7.5715 | 18.0 | 1278 | 6.3216 |
|
66 |
+
| 7.5715 | 19.0 | 1349 | 6.1973 |
|
67 |
+
| 7.5715 | 20.0 | 1420 | 6.0735 |
|
68 |
+
| 7.5715 | 21.0 | 1491 | 5.9483 |
|
69 |
+
| 6.6466 | 22.0 | 1562 | 5.8385 |
|
70 |
+
| 6.6466 | 23.0 | 1633 | 5.7199 |
|
71 |
+
| 6.6466 | 24.0 | 1704 | 5.6047 |
|
72 |
+
| 6.6466 | 25.0 | 1775 | 5.5008 |
|
73 |
+
| 6.6466 | 26.0 | 1846 | 5.3816 |
|
74 |
+
| 6.6466 | 27.0 | 1917 | 5.2802 |
|
75 |
+
| 6.6466 | 28.0 | 1988 | 5.1727 |
|
76 |
+
| 5.8483 | 29.0 | 2059 | 5.0741 |
|
77 |
+
| 5.8483 | 30.0 | 2130 | 4.9724 |
|
78 |
+
| 5.8483 | 31.0 | 2201 | 4.8772 |
|
79 |
+
| 5.8483 | 32.0 | 2272 | 4.7812 |
|
80 |
+
| 5.8483 | 33.0 | 2343 | 4.6847 |
|
81 |
+
| 5.8483 | 34.0 | 2414 | 4.5938 |
|
82 |
+
| 5.8483 | 35.0 | 2485 | 4.5092 |
|
83 |
+
| 5.1726 | 36.0 | 2556 | 4.4214 |
|
84 |
+
| 5.1726 | 37.0 | 2627 | 4.3330 |
|
85 |
+
| 5.1726 | 38.0 | 2698 | 4.2479 |
|
86 |
+
| 5.1726 | 39.0 | 2769 | 4.1682 |
|
87 |
+
| 5.1726 | 40.0 | 2840 | 4.0822 |
|
88 |
+
| 5.1726 | 41.0 | 2911 | 4.0075 |
|
89 |
+
| 5.1726 | 42.0 | 2982 | 3.9296 |
|
90 |
+
| 4.5503 | 43.0 | 3053 | 3.8511 |
|
91 |
+
| 4.5503 | 44.0 | 3124 | 3.7752 |
|
92 |
+
| 4.5503 | 45.0 | 3195 | 3.7009 |
|
93 |
+
| 4.5503 | 46.0 | 3266 | 3.6335 |
|
94 |
+
| 4.5503 | 47.0 | 3337 | 3.5647 |
|
95 |
+
| 4.5503 | 48.0 | 3408 | 3.4937 |
|
96 |
+
| 4.5503 | 49.0 | 3479 | 3.4242 |
|
97 |
+
| 4.009 | 50.0 | 3550 | 3.3637 |
|
98 |
+
| 4.009 | 51.0 | 3621 | 3.3031 |
|
99 |
+
| 4.009 | 52.0 | 3692 | 3.2395 |
|
100 |
+
| 4.009 | 53.0 | 3763 | 3.1766 |
|
101 |
+
| 4.009 | 54.0 | 3834 | 3.1246 |
|
102 |
+
| 4.009 | 55.0 | 3905 | 3.0673 |
|
103 |
+
| 4.009 | 56.0 | 3976 | 3.0090 |
|
104 |
+
| 3.5477 | 57.0 | 4047 | 2.9559 |
|
105 |
+
| 3.5477 | 58.0 | 4118 | 2.9098 |
|
106 |
+
| 3.5477 | 59.0 | 4189 | 2.8603 |
|
107 |
+
| 3.5477 | 60.0 | 4260 | 2.8132 |
|
108 |
+
| 3.5477 | 61.0 | 4331 | 2.7637 |
|
109 |
+
| 3.5477 | 62.0 | 4402 | 2.7219 |
|
110 |
+
| 3.5477 | 63.0 | 4473 | 2.6734 |
|
111 |
+
| 3.1822 | 64.0 | 4544 | 2.6286 |
|
112 |
+
| 3.1822 | 65.0 | 4615 | 2.5867 |
|
113 |
+
| 3.1822 | 66.0 | 4686 | 2.5491 |
|
114 |
+
| 3.1822 | 67.0 | 4757 | 2.5076 |
|
115 |
+
| 3.1822 | 68.0 | 4828 | 2.4720 |
|
116 |
+
| 3.1822 | 69.0 | 4899 | 2.4349 |
|
117 |
+
| 3.1822 | 70.0 | 4970 | 2.4026 |
|
118 |
+
| 2.8647 | 71.0 | 5041 | 2.3661 |
|
119 |
+
| 2.8647 | 72.0 | 5112 | 2.3343 |
|
120 |
+
| 2.8647 | 73.0 | 5183 | 2.3081 |
|
121 |
+
| 2.8647 | 74.0 | 5254 | 2.2751 |
|
122 |
+
| 2.8647 | 75.0 | 5325 | 2.2461 |
|
123 |
+
| 2.8647 | 76.0 | 5396 | 2.2165 |
|
124 |
+
| 2.8647 | 77.0 | 5467 | 2.1938 |
|
125 |
+
| 2.6306 | 78.0 | 5538 | 2.1681 |
|
126 |
+
| 2.6306 | 79.0 | 5609 | 2.1438 |
|
127 |
+
| 2.6306 | 80.0 | 5680 | 2.1232 |
|
128 |
+
| 2.6306 | 81.0 | 5751 | 2.1022 |
|
129 |
+
| 2.6306 | 82.0 | 5822 | 2.0800 |
|
130 |
+
| 2.6306 | 83.0 | 5893 | 2.0605 |
|
131 |
+
| 2.6306 | 84.0 | 5964 | 2.0427 |
|
132 |
+
| 2.4436 | 85.0 | 6035 | 2.0273 |
|
133 |
+
| 2.4436 | 86.0 | 6106 | 2.0109 |
|
134 |
+
| 2.4436 | 87.0 | 6177 | 1.9975 |
|
135 |
+
| 2.4436 | 88.0 | 6248 | 1.9827 |
|
136 |
+
| 2.4436 | 89.0 | 6319 | 1.9700 |
|
137 |
+
| 2.4436 | 90.0 | 6390 | 1.9584 |
|
138 |
+
| 2.4436 | 91.0 | 6461 | 1.9502 |
|
139 |
+
| 2.3168 | 92.0 | 6532 | 1.9394 |
|
140 |
+
| 2.3168 | 93.0 | 6603 | 1.9307 |
|
141 |
+
| 2.3168 | 94.0 | 6674 | 1.9221 |
|
142 |
+
| 2.3168 | 95.0 | 6745 | 1.9167 |
|
143 |
+
| 2.3168 | 96.0 | 6816 | 1.9122 |
|
144 |
+
| 2.3168 | 97.0 | 6887 | 1.9078 |
|
145 |
+
| 2.3168 | 98.0 | 6958 | 1.9055 |
|
146 |
+
| 2.2563 | 99.0 | 7029 | 1.9039 |
|
147 |
+
| 2.2563 | 100.0 | 7100 | 1.9029 |
|
148 |
|
149 |
|
150 |
### Framework versions
|