File size: 3,100 Bytes
5f9c125
a5d6f9c
 
 
e2437ad
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
5f9c125
 
a5d6f9c
5f9c125
a5d6f9c
 
e2437ad
 
 
a5d6f9c
e2437ad
 
a5d6f9c
e2437ad
 
 
 
 
 
 
 
 
5f9c125
a5d6f9c
5f9c125
a5d6f9c
 
e2437ad
 
5f9c125
a5d6f9c
5f9c125
a5d6f9c
5f9c125
a5d6f9c
5f9c125
a5d6f9c
 
 
 
 
 
 
 
 
 
 
 
 
 
5f9c125
a5d6f9c
5f9c125
 
 
 
 
 
a5d6f9c
 
 
 
9e11fca
15d4d4f
a251e41
3322898
9cd3a1b
1f84312
f95826b
b1fc8c2
351e053
15a1be1
806ffc5
26bc506
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
---
language: en
tags:
- fill-mask
kwargs:
  timestamp: '2024-05-25T18:35:29'
  project_name: fp_bs32_lr5_x4_emissions_tracker
  run_id: 76e6a081-c40e-4059-882d-3f3b6d2b891a
  duration: 201349.00879764557
  emissions: 0.1317182481933241
  emissions_rate: 6.541787763440154e-07
  cpu_power: 42.5
  gpu_power: 0.0
  ram_power: 7.5
  cpu_energy: 2.377032654036238
  gpu_energy: 0
  ram_energy: 0.4194737512061973
  energy_consumed: 2.7965064052424404
  country_name: Switzerland
  country_iso_code: CHE
  region: .nan
  cloud_provider: .nan
  cloud_region: .nan
  os: Linux-5.14.0-70.30.1.el9_0.x86_64-x86_64-with-glibc2.34
  python_version: 3.10.4
  codecarbon_version: 2.3.4
  cpu_count: 4
  cpu_model: Intel(R) Xeon(R) Platinum 8360Y CPU @ 2.40GHz
  gpu_count: .nan
  gpu_model: .nan
  longitude: .nan
  latitude: .nan
  ram_total_size: 20
  tracking_mode: machine
  on_cloud: N
  pue: 1.0
---

## Environmental Impact (CODE CARBON DEFAULT)

| Metric                   | Value                           |
|--------------------------|---------------------------------|
| Duration (in seconds)    | 201349.00879764557  |
| Emissions (Co2eq in kg)  | 0.1317182481933241 |
| CPU power (W)            | 42.5  |
| GPU power (W)            | [No GPU]  |
| RAM power (W)            | 7.5  |
| CPU energy (kWh)         | 2.377032654036238  |
| GPU energy (kWh)         | [No GPU]  |
| RAM energy (kWh)         | 0.4194737512061973  |
| Consumed energy (kWh)    | 2.7965064052424404  |
| Country name             | Switzerland  |
| Cloud provider           | nan  |
| Cloud region             | nan  |
| CPU count                | 4  |
| CPU model                | Intel(R) Xeon(R) Platinum 8360Y CPU @ 2.40GHz  |
| GPU count                | nan  |
| GPU model                | nan  |

## Environmental Impact (for one core)

| Metric                   | Value                           |
|--------------------------|---------------------------------|
| CPU energy (kWh)         | 0.3875968419354677  |
| Emissions (Co2eq in kg)  | 0.07886169511241117 |

## Note

23 May 2024

## My Config

| Config                   | Value           |
|--------------------------|-----------------|
| checkpoint               | albert-base-v2  |
| model_name               | fp_bs32_lr5_x4 |
| sequence_length          | 400  |
| num_epoch                | 6  |
| learning_rate            | 5e-05  |
| batch_size               | 32  |
| weight_decay             | 0.0  |
| warm_up_prop             | 0.0  |
| drop_out_prob            | 0.1 |
| packing_length           | 100 |
| train_test_split         | 0.2 |
| num_steps                | 20474 |

## Training and Testing steps






 
Epoch | Train Loss | Test Loss
---|---|---
| 0.0 | 13.351377 | 11.863091 |
| 0.5 | 4.567548 | 3.794884 |
| 1.0 | 3.590797 | 3.455211 |
| 1.5 | 3.345965 | 3.288297 |
| 2.0 | 3.198848 | 3.176345 |
| 2.5 | 3.093061 | 3.087619 |
| 3.0 | 3.012470 | 3.013932 |
| 3.5 | 2.945540 | 2.949879 |
| 4.0 | 2.882858 | 2.898032 |
| 4.5 | 2.832584 | 2.853366 |
| 5.0 | 2.791554 | 2.814966 |
| 5.5 | 2.747674 | 2.785408 |
| 6.0 | 2.712429 | 2.754928 |