File size: 3,098 Bytes
72334a3 a238a5b c205b92 72334a3 a238a5b 72334a3 a238a5b c205b92 a238a5b c205b92 a238a5b c205b92 72334a3 a238a5b 72334a3 a238a5b c205b92 72334a3 a238a5b 72334a3 a238a5b 72334a3 a238a5b 72334a3 a238a5b 72334a3 a238a5b 72334a3 a238a5b 02adb41 7ed878f 7c13282 ed18d17 2abe75c 816a632 c5db77f 5bdf20f ca2201b acad25a 12523e7 0ee1897 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 |
---
language: en
tags:
- fill-mask
kwargs:
timestamp: '2024-05-25T18:08:26'
project_name: fp_bs16_lr5_x4_emissions_tracker
run_id: 41c284d4-71f1-4b33-b649-65c136975a0a
duration: 199750.60248947144
emissions: 0.1306726388971817
emissions_rate: 6.541789474906303e-07
cpu_power: 42.5
gpu_power: 0.0
ram_power: 7.5
cpu_energy: 2.3581629528201304
gpu_energy: 0
ram_energy: 0.4161441510031621
energy_consumed: 2.77430710382331
country_name: Switzerland
country_iso_code: CHE
region: .nan
cloud_provider: .nan
cloud_region: .nan
os: Linux-5.14.0-70.30.1.el9_0.x86_64-x86_64-with-glibc2.34
python_version: 3.10.4
codecarbon_version: 2.3.4
cpu_count: 4
cpu_model: Intel(R) Xeon(R) Platinum 8360Y CPU @ 2.40GHz
gpu_count: .nan
gpu_model: .nan
longitude: .nan
latitude: .nan
ram_total_size: 20
tracking_mode: machine
on_cloud: N
pue: 1.0
---
## Environmental Impact (CODE CARBON DEFAULT)
| Metric | Value |
|--------------------------|---------------------------------|
| Duration (in seconds) | 199750.60248947144 |
| Emissions (Co2eq in kg) | 0.1306726388971817 |
| CPU power (W) | 42.5 |
| GPU power (W) | [No GPU] |
| RAM power (W) | 7.5 |
| CPU energy (kWh) | 2.3581629528201304 |
| GPU energy (kWh) | [No GPU] |
| RAM energy (kWh) | 0.4161441510031621 |
| Consumed energy (kWh) | 2.77430710382331 |
| Country name | Switzerland |
| Cloud provider | nan |
| Cloud region | nan |
| CPU count | 4 |
| CPU model | Intel(R) Xeon(R) Platinum 8360Y CPU @ 2.40GHz |
| GPU count | nan |
| GPU model | nan |
## Environmental Impact (for one core)
| Metric | Value |
|--------------------------|---------------------------------|
| CPU energy (kWh) | 0.3845199097922325 |
| Emissions (Co2eq in kg) | 0.07823565264170965 |
## Note
23 May 2024
## My Config
| Config | Value |
|--------------------------|-----------------|
| checkpoint | albert-base-v2 |
| model_name | fp_bs16_lr5_x4 |
| sequence_length | 400 |
| num_epoch | 6 |
| learning_rate | 5e-05 |
| batch_size | 16 |
| weight_decay | 0.0 |
| warm_up_prop | 0.0 |
| drop_out_prob | 0.1 |
| packing_length | 100 |
| train_test_split | 0.2 |
| num_steps | 40911 |
## Training and Testing steps
Epoch | Train Loss | Test Loss
---|---|---
| 0.0 | 16.038300 | 11.435867 |
| 0.5 | 4.387820 | 3.824438 |
| 1.0 | 3.580076 | 3.468719 |
| 1.5 | 3.337705 | 3.273031 |
| 2.0 | 3.178614 | 3.155824 |
| 2.5 | 3.066128 | 3.047407 |
| 3.0 | 2.977899 | 2.974327 |
| 3.5 | 2.898752 | 2.909501 |
| 4.0 | 2.834338 | 2.851398 |
| 4.5 | 2.787738 | 2.810708 |
| 5.0 | 2.723077 | 2.755004 |
| 5.5 | 2.680311 | 2.718634 |
| 6.0 | 2.655619 | 2.699163 |
|