File size: 3,760 Bytes
91ca1fa b21ca18 7ff92e8 91ca1fa b21ca18 91ca1fa b21ca18 7ff92e8 b21ca18 7ff92e8 b21ca18 7ff92e8 91ca1fa b21ca18 91ca1fa b21ca18 7ff92e8 91ca1fa b21ca18 91ca1fa b21ca18 91ca1fa b21ca18 91ca1fa b21ca18 91ca1fa b21ca18 91ca1fa b21ca18 9fc8345 d4d061e 21d9965 6bf33b0 b679484 95e3233 5b21763 89bfb6c d5b962b ce8cb5a 1dad51f 7977cea 4a9e94b 50e743b ebc29fc 8a6876c 70877ce f8ab8d8 b85cdc0 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 |
---
language: en
tags:
- fill-mask
kwargs:
timestamp: '2024-05-21T06:49:36'
project_name: ft_bs16_1lr6_base_x8_emissions_tracker
run_id: e8f58681-b571-4e35-a345-b5c77f7b4a7e
duration: 29334.1406750679
emissions: 0.0191897816027374
emissions_rate: 6.541790951131397e-07
cpu_power: 42.5
gpu_power: 0.0
ram_power: 7.5
cpu_energy: 0.3463053195810985
gpu_energy: 0
ram_energy: 0.0611123913536468
energy_consumed: 0.4074177109347459
country_name: Switzerland
country_iso_code: CHE
region: .nan
cloud_provider: .nan
cloud_region: .nan
os: Linux-5.14.0-70.30.1.el9_0.x86_64-x86_64-with-glibc2.34
python_version: 3.10.4
codecarbon_version: 2.3.4
cpu_count: 3
cpu_model: Intel(R) Xeon(R) Platinum 8360Y CPU @ 2.40GHz
gpu_count: .nan
gpu_model: .nan
longitude: .nan
latitude: .nan
ram_total_size: 20
tracking_mode: machine
on_cloud: N
pue: 1.0
---
## Environmental Impact (CODE CARBON DEFAULT)
| Metric | Value |
|--------------------------|---------------------------------|
| Duration (in seconds) | 29334.1406750679 |
| Emissions (Co2eq in kg) | 0.0191897816027374 |
| CPU power (W) | 42.5 |
| GPU power (W) | [No GPU] |
| RAM power (W) | 7.5 |
| CPU energy (kWh) | 0.3463053195810985 |
| GPU energy (kWh) | [No GPU] |
| RAM energy (kWh) | 0.0611123913536468 |
| Consumed energy (kWh) | 0.4074177109347459 |
| Country name | Switzerland |
| Cloud provider | nan |
| Cloud region | nan |
| CPU count | 3 |
| CPU model | Intel(R) Xeon(R) Platinum 8360Y CPU @ 2.40GHz |
| GPU count | nan |
| GPU model | nan |
## Environmental Impact (for one core)
| Metric | Value |
|--------------------------|---------------------------------|
| CPU energy (kWh) | 0.05646822079950571 |
| Emissions (Co2eq in kg) | 0.011489205097734928 |
## Note
20 May 2024
## My Config
| Config | Value |
|--------------------------|-----------------|
| checkpoint | albert-base-v2 |
| model_name | ft_bs16_1lr6_base_x8 |
| sequence_length | 400 |
| num_epoch | 20 |
| learning_rate | 1e-06 |
| batch_size | 16 |
| weight_decay | 0.0 |
| warm_up_prop | 0.0 |
| drop_out_prob | 0.1 |
| packing_length | 100 |
| train_test_split | 0.2 |
| num_steps | 108600 |
## Training and Testing steps
Epoch | Train Loss | Test Loss | Accuracy | Recall
---|---|---|---|---
| 0 | 0.523328 | 0.476205 | 0.776141 | 0.906442 |
| 1 | 0.431474 | 0.413639 | 0.813697 | 0.866564 |
| 2 | 0.384488 | 0.402209 | 0.823270 | 0.897239 |
| 3 | 0.353091 | 0.387237 | 0.822533 | 0.800613 |
| 4 | 0.328723 | 0.390632 | 0.836524 | 0.918712 |
| 5 | 0.314824 | 0.373720 | 0.835052 | 0.848160 |
| 6 | 0.299005 | 0.389435 | 0.810751 | 0.750000 |
| 7 | 0.289835 | 0.386018 | 0.835052 | 0.860429 |
| 8 | 0.273817 | 0.388888 | 0.829897 | 0.814417 |
| 9 | 0.257712 | 0.386943 | 0.837997 | 0.871166 |
| 10 | 0.236881 | 0.410112 | 0.832842 | 0.855828 |
| 11 | 0.218910 | 0.429738 | 0.820324 | 0.837423 |
| 12 | 0.207044 | 0.461636 | 0.832106 | 0.891104 |
| 13 | 0.192752 | 0.454077 | 0.817378 | 0.828221 |
| 14 | 0.167404 | 0.477347 | 0.802651 | 0.754601 |
| 15 | 0.146702 | 0.511787 | 0.810751 | 0.875767 |
| 16 | 0.134885 | 0.540342 | 0.814433 | 0.858896 |
| 17 | 0.118554 | 0.552969 | 0.807069 | 0.802147 |
| 18 | 0.105443 | 0.596917 | 0.805596 | 0.803681 |
| 19 | 0.085186 | 0.638636 | 0.796024 | 0.757669 |
|