File size: 3,098 Bytes
1e32d00
b442d1d
 
 
6c445fa
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1e32d00
 
b442d1d
1e32d00
b442d1d
 
6c445fa
 
 
b442d1d
6c445fa
 
b442d1d
6c445fa
 
 
 
 
 
 
 
 
1e32d00
b442d1d
1e32d00
b442d1d
 
6c445fa
 
1e32d00
b442d1d
1e32d00
b442d1d
1e32d00
b442d1d
1e32d00
b442d1d
 
 
 
 
 
 
 
 
 
 
 
 
9949814
1e32d00
b442d1d
1e32d00
 
 
 
 
 
b442d1d
 
 
9949814
61fe08f
5133cc9
09cb2e0
31de88e
c566412
e2ef169
cf5db15
7816afb
a541b6f
57d5fdc
0bee87c
c99a204
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
---
language: en
tags:
- fill-mask
kwargs:
  timestamp: '2024-05-25T03:37:28'
  project_name: fp_bs64_lr5_x4_emissions_tracker
  run_id: 07c3bbb2-f049-4b40-b3dd-956d28629ef7
  duration: 141339.0581598282
  emissions: 0.1063300462019785
  emissions_rate: 7.523047598190379e-07
  cpu_power: 42.5
  gpu_power: 0.0
  ram_power: 15.0
  cpu_energy: 1.668582685680036
  gpu_energy: 0
  ram_energy: 0.5889075205147284
  energy_consumed: 2.257490206194743
  country_name: Switzerland
  country_iso_code: CHE
  region: .nan
  cloud_provider: .nan
  cloud_region: .nan
  os: Linux-5.14.0-70.30.1.el9_0.x86_64-x86_64-with-glibc2.34
  python_version: 3.10.4
  codecarbon_version: 2.3.4
  cpu_count: 6
  cpu_model: Intel(R) Xeon(R) Platinum 8360Y CPU @ 2.40GHz
  gpu_count: .nan
  gpu_model: .nan
  longitude: .nan
  latitude: .nan
  ram_total_size: 40
  tracking_mode: machine
  on_cloud: N
  pue: 1.0
---

## Environmental Impact (CODE CARBON DEFAULT)

| Metric                   | Value                           |
|--------------------------|---------------------------------|
| Duration (in seconds)    | 141339.0581598282  |
| Emissions (Co2eq in kg)  | 0.1063300462019785 |
| CPU power (W)            | 42.5  |
| GPU power (W)            | [No GPU]  |
| RAM power (W)            | 15.0  |
| CPU energy (kWh)         | 1.668582685680036  |
| GPU energy (kWh)         | [No GPU]  |
| RAM energy (kWh)         | 0.5889075205147284  |
| Consumed energy (kWh)    | 2.257490206194743  |
| Country name             | Switzerland  |
| Cloud provider           | nan  |
| Cloud region             | nan  |
| CPU count                | 6  |
| CPU model                | Intel(R) Xeon(R) Platinum 8360Y CPU @ 2.40GHz  |
| GPU count                | nan  |
| GPU model                | nan  |

## Environmental Impact (for one core)

| Metric                   | Value                           |
|--------------------------|---------------------------------|
| CPU energy (kWh)         | 0.27207768695766926  |
| Emissions (Co2eq in kg)  | 0.05535779777926603 |

## Note

23 May 2024

## My Config

| Config                   | Value           |
|--------------------------|-----------------|
| checkpoint               | albert-base-v2  |
| model_name               | fp_bs64_lr5_x4 |
| sequence_length          | 400  |
| num_epoch                | 6  |
| learning_rate            | 5e-05  |
| batch_size               | 64  |
| weight_decay             | 0.0  |
| warm_up_prop             | 0.0  |
| drop_out_prob            | 0.1 |
| packing_length           | 100 |
| train_test_split         | 0.2 |
| num_steps                | 10278 |

## Training and Testing steps






 
Epoch | Train Loss | Test Loss
---|---|---
| 0.0 | 15.918249 | 9.392778 |
| 0.5 | 5.090525 | 4.007436 |
| 1.0 | 3.736158 | 3.569265 |
| 1.5 | 3.457080 | 3.366405 |
| 2.0 | 3.294382 | 3.235556 |
| 2.5 | 3.196004 | 3.175543 |
| 3.0 | 3.097808 | 3.081475 |
| 3.5 | 3.041380 | 3.029809 |
| 4.0 | 2.969532 | 2.984502 |
| 4.5 | 2.927619 | 2.950877 |
| 5.0 | 2.891346 | 2.897531 |
| 5.5 | 2.853556 | 2.867581 |
| 6.0 | 2.830631 | 2.856134 |