File size: 3,472 Bytes
3539a3b 82daa18 585e560 3539a3b 82daa18 3539a3b 82daa18 585e560 82daa18 585e560 82daa18 585e560 3539a3b 82daa18 3539a3b 82daa18 585e560 3539a3b 82daa18 3539a3b 82daa18 3539a3b 82daa18 3539a3b 82daa18 3539a3b 82daa18 3539a3b 82daa18 a507aae ee3ed86 9e6c2d3 597f95c 7324728 4904a2f 7e6f424 21210d5 9c0d373 b7ca21a df00e8c 327710c 743aa90 b289653 c25651c 29dc2b5 923069f 67bf6e5 0690a60 58bfa3d 1a2d36d 0099a30 a5a273d 7f1f010 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 |
---
language: en
tags:
- fill-mask
kwargs:
timestamp: '2024-05-04T02:15:26'
project_name: BERTrand_bs64_lr5_emissions_tracker
run_id: f7a0cdf6-c88d-4c9c-a4ae-06e00c61174a
duration: 210553.2843556404
emissions: 0.2720349058598398
emissions_rate: 1.292000296705666e-06
cpu_power: 42.5
gpu_power: 0.0
ram_power: 56.25
cpu_energy: 2.4856944445676237
gpu_energy: 0
ram_energy: 3.289870954465132
energy_consumed: 5.775565399032714
country_name: Switzerland
country_iso_code: CHE
region: .nan
cloud_provider: .nan
cloud_region: .nan
os: Linux-5.14.0-70.30.1.el9_0.x86_64-x86_64-with-glibc2.34
python_version: 3.10.4
codecarbon_version: 2.3.4
cpu_count: 4
cpu_model: Intel(R) Xeon(R) Platinum 8360Y CPU @ 2.40GHz
gpu_count: .nan
gpu_model: .nan
longitude: .nan
latitude: .nan
ram_total_size: 150
tracking_mode: machine
on_cloud: N
pue: 1.0
---
## Environmental Impact (CODE CARBON DEFAULT)
| Metric | Value |
|--------------------------|---------------------------------|
| Duration (in seconds) | 210553.2843556404 |
| Emissions (Co2eq in kg) | 0.2720349058598398 |
| CPU power (W) | 42.5 |
| GPU power (W) | [No GPU] |
| RAM power (W) | 56.25 |
| CPU energy (kWh) | 2.4856944445676237 |
| GPU energy (kWh) | [No GPU] |
| RAM energy (kWh) | 3.289870954465132 |
| Consumed energy (kWh) | 5.775565399032714 |
| Country name | Switzerland |
| Cloud provider | nan |
| Cloud region | nan |
| CPU count | 4 |
| CPU model | Intel(R) Xeon(R) Platinum 8360Y CPU @ 2.40GHz |
| GPU count | nan |
| GPU model | nan |
## Environmental Impact (for one core)
| Metric | Value |
|--------------------------|---------------------------------|
| CPU energy (kWh) | 0.4053150723846078 |
| Emissions (Co2eq in kg) | 0.08246670303929249 |
## Note
30 April 2024
## My Config
| Config | Value |
|--------------------------|-----------------|
| checkpoint | albert-base-v2 |
| model_name | BERTrand_bs64_lr5 |
| sequence_length | 400 |
| num_epoch | 12 |
| learning_rate | 5e-05 |
| batch_size | 64 |
| weight_decay | 0.0 |
| warm_up_prop | 0 |
| drop_out_prob | 0.1 |
| packing_length | 100 |
| train_test_split | 0.2 |
| num_steps | 3148 |
## Training and Testing steps
Epoch | Train Loss | Test Loss
---|---|---
| 0.0 | 15.402081 | 13.817045 |
| 0.5 | 8.054414 | 7.829068 |
| 1.0 | 4.816239 | 3.114260 |
| 1.5 | 2.206430 | 2.955595 |
| 2.0 | 2.189819 | 2.872115 |
| 2.5 | 2.418134 | 2.865437 |
| 3.0 | 2.349051 | 2.810524 |
| 3.5 | 2.102283 | 2.820134 |
| 4.0 | 1.907061 | 2.957294 |
| 4.5 | 2.326205 | 2.785392 |
| 5.0 | 2.257292 | 2.737638 |
| 5.5 | 2.127350 | 2.733068 |
| 6.0 | 1.883285 | 2.774372 |
| 6.5 | 2.100682 | 2.667502 |
| 7.0 | 2.194973 | 2.628296 |
| 7.5 | 2.163919 | 2.643665 |
| 8.0 | 1.850441 | 2.637510 |
| 8.5 | 1.968181 | 2.632833 |
| 9.0 | 2.121989 | 2.625116 |
| 9.5 | 2.136497 | 2.646418 |
| 10.0 | 1.891819 | 2.655790 |
| 10.5 | 1.822331 | 2.596789 |
| 11.0 | 2.116980 | 2.584595 |
| 11.5 | 2.101184 | 2.588414 |
| 12.0 | 1.961101 | 2.560519 |
|