File size: 3,101 Bytes
6dc9d55
7cff150
 
 
faae5de
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
6dc9d55
 
7cff150
6dc9d55
7cff150
 
faae5de
 
 
7cff150
faae5de
 
7cff150
faae5de
 
 
 
 
 
 
 
 
6dc9d55
7cff150
6dc9d55
7cff150
 
faae5de
 
6dc9d55
7cff150
6dc9d55
7cff150
6dc9d55
7cff150
6dc9d55
7cff150
 
 
 
 
 
 
 
 
 
 
 
 
 
6dc9d55
7cff150
6dc9d55
 
 
 
 
 
7cff150
 
 
 
b9bdd4d
829200e
5f9765c
1c5505c
159892b
d125d46
5ea747e
60b72ab
49a9313
6c84dcc
e982399
9c16227
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
---
language: en
tags:
- fill-mask
kwargs:
  timestamp: '2024-06-27T20:43:54'
  project_name: fp_bs4_lr5_x8_emissions_tracker
  run_id: 9c2b5b21-9750-4206-9569-387a2b7d15f8
  duration: 208490.08250188828
  emissions: 0.1568480215083055
  emissions_rate: 7.523044723572641e-07
  cpu_power: 42.5
  gpu_power: 0.0
  ram_power: 15.0
  cpu_energy: 2.461335938281156
  gpu_energy: 0
  ram_energy: 0.8686999740839002
  energy_consumed: 3.330035912365035
  country_name: Switzerland
  country_iso_code: CHE
  region: .nan
  cloud_provider: .nan
  cloud_region: .nan
  os: Linux-5.14.0-70.30.1.el9_0.x86_64-x86_64-with-glibc2.34
  python_version: 3.10.4
  codecarbon_version: 2.3.4
  cpu_count: 6
  cpu_model: Intel(R) Xeon(R) Platinum 8360Y CPU @ 2.40GHz
  gpu_count: .nan
  gpu_model: .nan
  longitude: .nan
  latitude: .nan
  ram_total_size: 40
  tracking_mode: machine
  on_cloud: N
  pue: 1.0
---

## Environmental Impact (CODE CARBON DEFAULT)

| Metric                   | Value                           |
|--------------------------|---------------------------------|
| Duration (in seconds)    | 208490.08250188828  |
| Emissions (Co2eq in kg)  | 0.1568480215083055 |
| CPU power (W)            | 42.5  |
| GPU power (W)            | [No GPU]  |
| RAM power (W)            | 15.0  |
| CPU energy (kWh)         | 2.461335938281156  |
| GPU energy (kWh)         | [No GPU]  |
| RAM energy (kWh)         | 0.8686999740839002  |
| Consumed energy (kWh)    | 3.330035912365035  |
| Country name             | Switzerland  |
| Cloud provider           | nan  |
| Cloud region             | nan  |
| CPU count                | 6  |
| CPU model                | Intel(R) Xeon(R) Platinum 8360Y CPU @ 2.40GHz  |
| GPU count                | nan  |
| GPU model                | nan  |

## Environmental Impact (for one core)

| Metric                   | Value                           |
|--------------------------|---------------------------------|
| CPU energy (kWh)         | 0.4013434088161349  |
| Emissions (Co2eq in kg)  | 0.08165861564657291 |

## Note

24 juin 2024 !

## My Config

| Config                   | Value           |
|--------------------------|-----------------|
| checkpoint               | albert-base-v2  |
| model_name               | fp_bs4_lr5_x8 |
| sequence_length          | 400  |
| num_epoch                | 6  |
| learning_rate            | 5e-05  |
| batch_size               | 4  |
| weight_decay             | 0.0  |
| warm_up_prop             | 0.0  |
| drop_out_prob            | 0.1 |
| packing_length           | 100 |
| train_test_split         | 0.2 |
| num_steps                | 164073 |

## Training and Testing steps






 
Epoch | Train Loss | Test Loss
---|---|---
| 0.0 | 13.089132 | 11.385561 |
| 0.5 | 4.059727 | 3.669117 |
| 1.0 | 3.514628 | 3.423268 |
| 1.5 | 3.314988 | 3.295123 |
| 2.0 | 3.175144 | 3.186192 |
| 2.5 | 3.077100 | 3.083530 |
| 3.0 | 2.998466 | 3.025474 |
| 3.5 | 2.926265 | 2.971895 |
| 4.0 | 2.864591 | 2.906877 |
| 4.5 | 2.803545 | 2.856923 |
| 5.0 | 2.747675 | 2.814351 |
| 5.5 | 2.699872 | 2.777204 |
| 6.0 | 2.671672 | 2.749017 |