File size: 3,470 Bytes
0393952
086591c
 
 
88b8da6
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
0393952
 
086591c
0393952
086591c
 
88b8da6
 
 
086591c
88b8da6
 
086591c
88b8da6
 
 
 
 
 
 
 
 
0393952
086591c
0393952
086591c
 
88b8da6
 
0393952
086591c
0393952
086591c
0393952
086591c
0393952
086591c
 
 
 
 
 
 
 
 
 
 
 
 
 
0393952
086591c
0393952
 
 
 
 
 
086591c
 
 
 
13feff6
1e35088
349ca07
eae8613
e8f3f04
9452e83
5f8d69d
db8fbeb
0597733
555343e
dbf6958
f31ec86
4185a60
b0d803f
2baf08b
2bd8ab7
2872918
da18084
8fe2eb6
0720b44
2601b7a
42ca151
43de239
fff7007
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
---
language: en
tags:
- fill-mask
kwargs:
  timestamp: '2024-05-04T03:41:40'
  project_name: BERTrand_bs32_lr5_emissions_tracker
  run_id: 96601345-e00c-4518-bad5-88b8b3e7ffa1
  duration: 215893.2022356987
  emissions: 0.2259719345261451
  emissions_rate: 1.0466838797427405e-06
  cpu_power: 42.5
  gpu_power: 0.0
  ram_power: 37.5
  cpu_energy: 2.548734558446212
  gpu_energy: 0
  ram_energy: 2.248869197867814
  energy_consumed: 4.797603756313989
  country_name: Switzerland
  country_iso_code: CHE
  region: .nan
  cloud_provider: .nan
  cloud_region: .nan
  os: Linux-5.14.0-70.30.1.el9_0.x86_64-x86_64-with-glibc2.34
  python_version: 3.10.4
  codecarbon_version: 2.3.4
  cpu_count: 4
  cpu_model: Intel(R) Xeon(R) Platinum 8360Y CPU @ 2.40GHz
  gpu_count: .nan
  gpu_model: .nan
  longitude: .nan
  latitude: .nan
  ram_total_size: 100
  tracking_mode: machine
  on_cloud: N
  pue: 1.0
---

## Environmental Impact (CODE CARBON DEFAULT)

| Metric                   | Value                           |
|--------------------------|---------------------------------|
| Duration (in seconds)    | 215893.2022356987  |
| Emissions (Co2eq in kg)  | 0.2259719345261451 |
| CPU power (W)            | 42.5  |
| GPU power (W)            | [No GPU]  |
| RAM power (W)            | 37.5  |
| CPU energy (kWh)         | 2.548734558446212  |
| GPU energy (kWh)         | [No GPU]  |
| RAM energy (kWh)         | 2.248869197867814  |
| Consumed energy (kWh)    | 4.797603756313989  |
| Country name             | Switzerland  |
| Cloud provider           | nan  |
| Cloud region             | nan  |
| CPU count                | 4  |
| CPU model                | Intel(R) Xeon(R) Platinum 8360Y CPU @ 2.40GHz  |
| GPU count                | nan  |
| GPU model                | nan  |

## Environmental Impact (for one core)

| Metric                   | Value                           |
|--------------------------|---------------------------------|
| CPU energy (kWh)         | 0.41559441430371996  |
| Emissions (Co2eq in kg)  | 0.08455817087564864 |

## Note

30 April 2024

## My Config

| Config                   | Value           |
|--------------------------|-----------------|
| checkpoint               | albert-base-v2  |
| model_name               | BERTrand_bs32_lr5 |
| sequence_length          | 400  |
| num_epoch                | 12  |
| learning_rate            | 5e-05  |
| batch_size               | 32  |
| weight_decay             | 0.0  |
| warm_up_prop             | 0  |
| drop_out_prob            | 0.1 |
| packing_length           | 100 |
| train_test_split         | 0.2 |
| num_steps                | 6287 |

## Training and Testing steps






 
Epoch | Train Loss | Test Loss
---|---|---
| 0.0 | 15.495780 | 13.831327 |
| 0.5 | 7.825472 | 7.840593 |
| 1.0 | 7.327533 | 7.785610 |
| 1.5 | 7.205367 | 7.586150 |
| 2.0 | 7.151769 | 7.663743 |
| 2.5 | 7.125600 | 8.101605 |
| 3.0 | 7.034717 | 7.773854 |
| 3.5 | 7.092155 | 7.549316 |
| 4.0 | 7.067814 | 7.819034 |
| 4.5 | 7.141888 | 7.587213 |
| 5.0 | 7.006890 | 7.892200 |
| 5.5 | 7.049742 | 7.752103 |
| 6.0 | 7.048553 | 7.844037 |
| 6.5 | 7.096755 | 7.641740 |
| 7.0 | 6.994647 | 7.617568 |
| 7.5 | 6.993773 | 7.864096 |
| 8.0 | 7.058714 | 7.730159 |
| 8.5 | 7.064419 | 7.629280 |
| 9.0 | 7.013462 | 7.746540 |
| 9.5 | 6.962919 | 8.147570 |
| 10.0 | 7.028505 | 7.587558 |
| 10.5 | 7.022366 | 7.531848 |
| 11.0 | 7.059191 | 7.623211 |
| 11.5 | 6.955125 | 7.734247 |
| 12.0 | 7.028196 | 7.606153 |