Environmental Impact (CODE CARBON DEFAULT)
Metric | Value |
---|---|
Duration (in seconds) | 19140.974267959595 |
Emissions (Co2eq in kg) | 0.0125216234646344 |
CPU power (W) | 42.5 |
GPU power (W) | [No GPU] |
RAM power (W) | 7.5 |
CPU energy (kWh) | 0.2259694842797186 |
GPU energy (kWh) | [No GPU] |
RAM energy (kWh) | 0.0398767496565978 |
Consumed energy (kWh) | 0.265846233936316 |
Country name | Switzerland |
Cloud provider | nan |
Cloud region | nan |
CPU count | 3 |
CPU model | Intel(R) Xeon(R) Platinum 8360Y CPU @ 2.40GHz |
GPU count | nan |
GPU model | nan |
Environmental Impact (for one core)
Metric | Value |
---|---|
CPU energy (kWh) | 0.036846375465822215 |
Emissions (Co2eq in kg) | 0.0074968815882841735 |
Note
20 May 2024
My Config
Config | Value |
---|---|
checkpoint | damgomz/ThunBERT_bs16_lr5_MLM |
model_name | ft_bs64_lr7_mlm |
sequence_length | 400 |
num_epoch | 15 |
learning_rate | 5e-07 |
batch_size | 64 |
weight_decay | 0.0 |
warm_up_prop | 0.0 |
drop_out_prob | 0.1 |
packing_length | 100 |
train_test_split | 0.2 |
num_steps | 81450 |
Training and Testing steps
Epoch | Train Loss | Test Loss | Accuracy | Recall |
---|---|---|---|---|
0 | 0.681750 | 0.650938 | 0.675258 | 0.677914 |
1 | 0.620596 | 0.590201 | 0.706186 | 0.838957 |
2 | 0.561438 | 0.541534 | 0.731222 | 0.828221 |
3 | 0.517364 | 0.505266 | 0.757732 | 0.857362 |
4 | 0.481140 | 0.471585 | 0.787923 | 0.871166 |
5 | 0.445565 | 0.441544 | 0.804860 | 0.877301 |
6 | 0.416452 | 0.418398 | 0.810751 | 0.840491 |
7 | 0.397176 | 0.402198 | 0.818115 | 0.860429 |
8 | 0.381283 | 0.391362 | 0.818851 | 0.861963 |
9 | 0.368698 | 0.386014 | 0.827688 | 0.883436 |
10 | 0.360030 | 0.378365 | 0.828424 | 0.880368 |
11 | 0.351088 | 0.372454 | 0.827688 | 0.865031 |
12 | 0.344274 | 0.368691 | 0.832106 | 0.868098 |
13 | 0.336930 | 0.368929 | 0.835788 | 0.894172 |
14 | 0.331037 | 0.363933 | 0.840943 | 0.880368 |
- Downloads last month
- 3