File size: 3,045 Bytes
543065d
f892cf3
 
 
fc57cda
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
543065d
 
f892cf3
543065d
f892cf3
 
fc57cda
 
 
f892cf3
fc57cda
 
f892cf3
fc57cda
 
 
 
 
 
 
 
 
543065d
f892cf3
543065d
f892cf3
 
fc57cda
 
543065d
f892cf3
543065d
f892cf3
543065d
f892cf3
543065d
f892cf3
 
 
 
 
 
 
 
 
 
 
 
 
996c56b
543065d
f892cf3
543065d
 
 
 
 
 
f892cf3
 
 
2ec3f6c
66c57b7
2fea33e
8b40f23
0fbd0bb
a502d43
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
---
language: en
tags:
- fill-mask
kwargs:
  timestamp: '2024-05-22T15:47:08'
  project_name: ft_16_1e6_cv_emissions_tracker
  run_id: 3351543a-9f08-4748-9d24-d177e974c299
  duration: 83465.50871014595
  emissions: 0.0505062485218885
  emissions_rate: 6.051152062977732e-07
  cpu_power: 42.5
  gpu_power: 0.0
  ram_power: 3.75
  cpu_energy: 0.9853544236797442
  gpu_energy: 0
  ram_energy: 0.0869423114615182
  energy_consumed: 1.0722967351412616
  country_name: Switzerland
  country_iso_code: CHE
  region: .nan
  cloud_provider: .nan
  cloud_region: .nan
  os: Linux-5.14.0-70.30.1.el9_0.x86_64-x86_64-with-glibc2.34
  python_version: 3.10.4
  codecarbon_version: 2.3.4
  cpu_count: 2
  cpu_model: Intel(R) Xeon(R) Platinum 8360Y CPU @ 2.40GHz
  gpu_count: .nan
  gpu_model: .nan
  longitude: .nan
  latitude: .nan
  ram_total_size: 10
  tracking_mode: machine
  on_cloud: N
  pue: 1.0
---

## Environmental Impact (CODE CARBON DEFAULT)

| Metric                   | Value                           |
|--------------------------|---------------------------------|
| Duration (in seconds)    | 83465.50871014595  |
| Emissions (Co2eq in kg)  | 0.0505062485218885 |
| CPU power (W)            | 42.5  |
| GPU power (W)            | [No GPU]  |
| RAM power (W)            | 3.75  |
| CPU energy (kWh)         | 0.9853544236797442  |
| GPU energy (kWh)         | [No GPU]  |
| RAM energy (kWh)         | 0.0869423114615182  |
| Consumed energy (kWh)    | 1.0722967351412616  |
| Country name             | Switzerland  |
| Cloud provider           | nan  |
| Cloud region             | nan  |
| CPU count                | 2  |
| CPU model                | Intel(R) Xeon(R) Platinum 8360Y CPU @ 2.40GHz  |
| GPU count                | nan  |
| GPU model                | nan  |

## Environmental Impact (for one core)

| Metric                   | Value                           |
|--------------------------|---------------------------------|
| CPU energy (kWh)         | 0.16067110426703096  |
| Emissions (Co2eq in kg)  | 0.0326906575781405 |

## Note

21 May 2024

## My Config

| Config                   | Value           |
|--------------------------|-----------------|
| checkpoint               | damgomz/ThunBERT_bs32_lr5  |
| model_name               | ft_16_1e6_cv |
| sequence_length          | 400  |
| num_epoch                | 6  |
| learning_rate            | 1e-06  |
| batch_size               | 16  |
| weight_decay             | 0.0  |
| warm_up_prop             | 0.0  |
| drop_out_prob            | 0.1 |
| packing_length           | 100 |
| train_test_split         | 0.2 |
| num_steps                | 32586 |

## Training and Testing steps






 
Epoch | Train Loss | Test Loss | Accuracy | Recall
---|---|---|---|---
| 0 | 0.613570 | 0.533018 | 0.737477 | 0.881819 |
| 1 | 0.489994 | 0.451972 | 0.794342 | 0.833306 |
| 2 | 0.409385 | 0.398267 | 0.822773 | 0.865210 |
| 3 | 0.358597 | 0.379467 | 0.828665 | 0.850640 |
| 4 | 0.328654 | 0.372455 | 0.833086 | 0.845936 |
| 5 | 0.301602 | 0.373118 | 0.837210 | 0.850023 |