File size: 3,097 Bytes
8034474
5f4040b
 
 
10b7876
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
8034474
 
5f4040b
8034474
5f4040b
 
10b7876
 
 
5f4040b
10b7876
 
5f4040b
10b7876
 
 
 
 
 
 
 
 
8034474
5f4040b
8034474
5f4040b
 
10b7876
 
8034474
5f4040b
8034474
5f4040b
8034474
5f4040b
8034474
5f4040b
 
 
 
 
 
 
 
 
 
 
 
 
 
8034474
5f4040b
8034474
 
 
 
 
 
5f4040b
 
 
 
3b9d076
567c112
eee56da
5ff4cbf
bd45a45
667fc19
05d50e2
6a3cf4c
e1f4e71
5e76dc4
da29998
baa2b6d
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
---
language: en
tags:
- fill-mask
kwargs:
  timestamp: '2024-05-25T20:06:02'
  project_name: fp_bs32_lr5_x2_emissions_tracker
  run_id: 2d50eb04-1ba2-480c-b597-9651f18ce006
  duration: 206961.3233139515
  emissions: 0.1353896769795261
  emissions_rate: 6.541786398135162e-07
  cpu_power: 42.5
  gpu_power: 0.0
  ram_power: 7.5
  cpu_energy: 2.443288704403909
  gpu_energy: 0
  ram_energy: 0.4311657016495866
  energy_consumed: 2.874454406053505
  country_name: Switzerland
  country_iso_code: CHE
  region: .nan
  cloud_provider: .nan
  cloud_region: .nan
  os: Linux-5.14.0-70.30.1.el9_0.x86_64-x86_64-with-glibc2.34
  python_version: 3.10.4
  codecarbon_version: 2.3.4
  cpu_count: 4
  cpu_model: Intel(R) Xeon(R) Platinum 8360Y CPU @ 2.40GHz
  gpu_count: .nan
  gpu_model: .nan
  longitude: .nan
  latitude: .nan
  ram_total_size: 20
  tracking_mode: machine
  on_cloud: N
  pue: 1.0
---

## Environmental Impact (CODE CARBON DEFAULT)

| Metric                   | Value                           |
|--------------------------|---------------------------------|
| Duration (in seconds)    | 206961.3233139515  |
| Emissions (Co2eq in kg)  | 0.1353896769795261 |
| CPU power (W)            | 42.5  |
| GPU power (W)            | [No GPU]  |
| RAM power (W)            | 7.5  |
| CPU energy (kWh)         | 2.443288704403909  |
| GPU energy (kWh)         | [No GPU]  |
| RAM energy (kWh)         | 0.4311657016495866  |
| Consumed energy (kWh)    | 2.874454406053505  |
| Country name             | Switzerland  |
| Cloud provider           | nan  |
| Cloud region             | nan  |
| CPU count                | 4  |
| CPU model                | Intel(R) Xeon(R) Platinum 8360Y CPU @ 2.40GHz  |
| GPU count                | nan  |
| GPU model                | nan  |

## Environmental Impact (for one core)

| Metric                   | Value                           |
|--------------------------|---------------------------------|
| CPU energy (kWh)         | 0.39840054737935665  |
| Emissions (Co2eq in kg)  | 0.08105985163129766 |

## Note

23 May 2024

## My Config

| Config                   | Value           |
|--------------------------|-----------------|
| checkpoint               | albert-base-v2  |
| model_name               | fp_bs32_lr5_x2 |
| sequence_length          | 400  |
| num_epoch                | 6  |
| learning_rate            | 5e-05  |
| batch_size               | 32  |
| weight_decay             | 0.0  |
| warm_up_prop             | 0.0  |
| drop_out_prob            | 0.1 |
| packing_length           | 100 |
| train_test_split         | 0.2 |
| num_steps                | 20858 |

## Training and Testing steps






 
Epoch | Train Loss | Test Loss
---|---|---
| 0.0 | 16.366634 | 11.998799 |
| 0.5 | 7.070860 | 6.991149 |
| 1.0 | 6.967975 | 6.968658 |
| 1.5 | 6.961848 | 6.959475 |
| 2.0 | 6.958854 | 6.956175 |
| 2.5 | 6.938891 | 6.952820 |
| 3.0 | 6.948310 | 6.945537 |
| 3.5 | 6.945998 | 6.951063 |
| 4.0 | 6.935990 | 6.948559 |
| 4.5 | 6.936107 | 6.946336 |
| 5.0 | 6.930304 | 6.939602 |
| 5.5 | 6.928085 | 6.939915 |
| 6.0 | 6.932602 | 6.942121 |