Update README.md
Browse files
README.md
CHANGED
@@ -18,14 +18,21 @@ The model is intended to identify skepticism of COVID-19 policies (i.e. masks, s
|
|
18 |
|
19 |
It's a pretty simple task but I used a grid search to optimize hyperparameters. The final model is achieves the following results and uses the following hyperparamters:
|
20 |
|
21 |
-
|
22 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
23 |
|
24 |
Optimized Hyperparameters
|
25 |
----------------------------------------------------------------------------------------------------
|
26 |
-
The best learning rate is: 5.4761828368201554e-05
|
27 |
-
The best weight decay is: 0.0003655991822889909
|
28 |
-
The best epoch is : 6
|
29 |
-
The best train split is : 0.3284489429375188
|
30 |
|
31 |
|
|
|
18 |
|
19 |
It's a pretty simple task but I used a grid search to optimize hyperparameters. The final model is achieves the following results and uses the following hyperparamters:
|
20 |
|
21 |
+
- 'train_runtime': 174.3258
|
22 |
+
- 'train_samples_per_second': 18.896
|
23 |
+
- 'train_steps_per_second': 2.375
|
24 |
+
- 'train_loss': 0.1576320076910194
|
25 |
+
- 'eval_loss': 0.8522606492042542
|
26 |
+
- 'eval_runtime': 3.8368
|
27 |
+
- 'eval_samples_per_second': 70.111
|
28 |
+
- 'eval_steps_per_second': 8.862
|
29 |
+
- 'epoch': 6.0
|
30 |
|
31 |
Optimized Hyperparameters
|
32 |
----------------------------------------------------------------------------------------------------
|
33 |
+
- The best learning rate is: 5.4761828368201554e-05
|
34 |
+
- The best weight decay is: 0.0003655991822889909
|
35 |
+
- The best epoch is : 6
|
36 |
+
- The best train split is : 0.3284489429375188
|
37 |
|
38 |
|