File size: 3,114 Bytes
da63731 9270544 bfcb5a5 da63731 9270544 da63731 9270544 bfcb5a5 9270544 bfcb5a5 9270544 bfcb5a5 da63731 9270544 da63731 9270544 bfcb5a5 da63731 9270544 da63731 9270544 da63731 9270544 da63731 9270544 da63731 9270544 da63731 9270544 10e183a e8a478b f836429 2b9625f 55524cf 7fb675d d1eafeb b35a384 08187f1 93bfc95 741ba6c 49ee6d7 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 |
---
language: en
tags:
- fill-mask
kwargs:
timestamp: '2024-07-12T04:07:38'
project_name: fp_bs16_lr2e4_x2_emissions_tracker
run_id: bfad8449-f45f-4490-9c09-b615a393a8ef
duration: 123183.01009082794
emissions: 0.0926712331077666
emissions_rate: 7.52305314177956e-07
cpu_power: 42.5
gpu_power: 0.0
ram_power: 15.0
cpu_energy: 1.4542414543996254
gpu_energy: 0
ram_energy: 0.5132588769684232
energy_consumed: 1.9675003313680524
country_name: Switzerland
country_iso_code: CHE
region: .nan
cloud_provider: .nan
cloud_region: .nan
os: Linux-5.14.0-70.30.1.el9_0.x86_64-x86_64-with-glibc2.34
python_version: 3.10.4
codecarbon_version: 2.3.4
cpu_count: 6
cpu_model: Intel(R) Xeon(R) Platinum 8360Y CPU @ 2.40GHz
gpu_count: .nan
gpu_model: .nan
longitude: .nan
latitude: .nan
ram_total_size: 40
tracking_mode: machine
on_cloud: N
pue: 1.0
---
## Environmental Impact (CODE CARBON DEFAULT)
| Metric | Value |
|--------------------------|---------------------------------|
| Duration (in seconds) | 123183.01009082794 |
| Emissions (Co2eq in kg) | 0.0926712331077666 |
| CPU power (W) | 42.5 |
| GPU power (W) | [No GPU] |
| RAM power (W) | 15.0 |
| CPU energy (kWh) | 1.4542414543996254 |
| GPU energy (kWh) | [No GPU] |
| RAM energy (kWh) | 0.5132588769684232 |
| Consumed energy (kWh) | 1.9675003313680524 |
| Country name | Switzerland |
| Cloud provider | nan |
| Cloud region | nan |
| CPU count | 6 |
| CPU model | Intel(R) Xeon(R) Platinum 8360Y CPU @ 2.40GHz |
| GPU count | nan |
| GPU model | nan |
## Environmental Impact (for one core)
| Metric | Value |
|--------------------------|---------------------------------|
| CPU energy (kWh) | 0.23712729442484376 |
| Emissions (Co2eq in kg) | 0.04824667895224094 |
## Note
5 juillet 2024 !
## My Config
| Config | Value |
|--------------------------|-----------------|
| checkpoint | albert-base-v2 |
| model_name | fp_bs16_lr2e4_x2 |
| sequence_length | 400 |
| num_epoch | 6 |
| learning_rate | 0.0002 |
| batch_size | 16 |
| weight_decay | 0.0 |
| warm_up_prop | 0.0 |
| drop_out_prob | 0.1 |
| packing_length | 100 |
| train_test_split | 0.2 |
| num_steps | 41210 |
## Training and Testing steps
Epoch | Train Loss | Test Loss
---|---|---
| 0.0 | 15.508738 | 13.453564 |
| 0.5 | 3.852050 | 3.397609 |
| 1.0 | 3.251526 | 3.176829 |
| 1.5 | 3.058468 | 3.015703 |
| 2.0 | 5.927741 | 6.965355 |
| 2.5 | 6.956331 | 6.956432 |
| 3.0 | 6.951731 | 6.962861 |
| 3.5 | 6.950335 | 6.958723 |
| 4.0 | 6.946852 | 6.955874 |
| 4.5 | 6.950789 | 6.954085 |
| 5.0 | 6.937664 | 6.950021 |
| 5.5 | 6.947318 | 6.950066 |
| 6.0 | 6.932711 | 6.952001 |
|