File size: 3,101 Bytes
8712e7d 3d17a72 f0c44e6 8712e7d 3d17a72 8712e7d 3d17a72 f0c44e6 3d17a72 f0c44e6 3d17a72 f0c44e6 8712e7d 3d17a72 8712e7d 3d17a72 f0c44e6 8712e7d 3d17a72 8712e7d 3d17a72 8712e7d 3d17a72 8712e7d 3d17a72 8712e7d 3d17a72 8712e7d 3d17a72 b6026dd e455e56 d52fad9 5106e39 d235565 a159615 071cb4c b3bbb3b 5b78715 33e20ec 30ba5c8 cac2c7e |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 |
---
language: en
tags:
- fill-mask
kwargs:
timestamp: '2024-05-25T18:41:48'
project_name: fp_bs32_lr5_x12_emissions_tracker
run_id: 8b567275-a809-4979-89cf-c7d717552867
duration: 201453.1611688137
emissions: 0.1317863700331207
emissions_rate: 6.541787146377236e-07
cpu_power: 42.5
gpu_power: 0.0
ram_power: 7.5
cpu_energy: 2.378262123556449
gpu_energy: 0
ram_energy: 0.4196905745416857
energy_consumed: 2.7979526980981446
country_name: Switzerland
country_iso_code: CHE
region: .nan
cloud_provider: .nan
cloud_region: .nan
os: Linux-5.14.0-70.30.1.el9_0.x86_64-x86_64-with-glibc2.34
python_version: 3.10.4
codecarbon_version: 2.3.4
cpu_count: 4
cpu_model: Intel(R) Xeon(R) Platinum 8360Y CPU @ 2.40GHz
gpu_count: .nan
gpu_model: .nan
longitude: .nan
latitude: .nan
ram_total_size: 20
tracking_mode: machine
on_cloud: N
pue: 1.0
---
## Environmental Impact (CODE CARBON DEFAULT)
| Metric | Value |
|--------------------------|---------------------------------|
| Duration (in seconds) | 201453.1611688137 |
| Emissions (Co2eq in kg) | 0.1317863700331207 |
| CPU power (W) | 42.5 |
| GPU power (W) | [No GPU] |
| RAM power (W) | 7.5 |
| CPU energy (kWh) | 2.378262123556449 |
| GPU energy (kWh) | [No GPU] |
| RAM energy (kWh) | 0.4196905745416857 |
| Consumed energy (kWh) | 2.7979526980981446 |
| Country name | Switzerland |
| Cloud provider | nan |
| Cloud region | nan |
| CPU count | 4 |
| CPU model | Intel(R) Xeon(R) Platinum 8360Y CPU @ 2.40GHz |
| GPU count | nan |
| GPU model | nan |
## Environmental Impact (for one core)
| Metric | Value |
|--------------------------|---------------------------------|
| CPU energy (kWh) | 0.38779733524996635 |
| Emissions (Co2eq in kg) | 0.07890248812445204 |
## Note
23 May 2024
## My Config
| Config | Value |
|--------------------------|-----------------|
| checkpoint | albert-base-v2 |
| model_name | fp_bs32_lr5_x12 |
| sequence_length | 400 |
| num_epoch | 6 |
| learning_rate | 5e-05 |
| batch_size | 32 |
| weight_decay | 0.0 |
| warm_up_prop | 0.0 |
| drop_out_prob | 0.1 |
| packing_length | 100 |
| train_test_split | 0.2 |
| num_steps | 20692 |
## Training and Testing steps
Epoch | Train Loss | Test Loss
---|---|---
| 0.0 | 15.421972 | 13.059559 |
| 0.5 | 4.497486 | 4.070924 |
| 1.0 | 3.918884 | 3.823591 |
| 1.5 | 3.720594 | 3.667123 |
| 2.0 | 3.583184 | 3.566541 |
| 2.5 | 3.484332 | 3.466024 |
| 3.0 | 3.405282 | 3.404479 |
| 3.5 | 3.322916 | 3.341581 |
| 4.0 | 3.257505 | 3.292218 |
| 4.5 | 3.211615 | 3.236657 |
| 5.0 | 3.172503 | 3.200394 |
| 5.5 | 3.131317 | 3.165646 |
| 6.0 | 3.103778 | 3.159209 |
|