File size: 3,052 Bytes
8c1ead3 3f942b6 0c66847 8c1ead3 3f942b6 8c1ead3 3f942b6 0c66847 3f942b6 0c66847 3f942b6 0c66847 8c1ead3 3f942b6 8c1ead3 3f942b6 0c66847 8c1ead3 3f942b6 8c1ead3 3f942b6 8c1ead3 3f942b6 8c1ead3 3f942b6 79acc37 8c1ead3 3f942b6 8c1ead3 3f942b6 f20f016 bd279b7 c58e63f 117142d 27dd20f fcf95e3 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 |
---
language: en
tags:
- fill-mask
kwargs:
timestamp: '2024-05-22T16:01:21'
project_name: ft_32_2e6_mlm_cv_emissions_tracker
run_id: 80bc0bd0-9bbf-4d23-9626-0fb32f9119ae
duration: 84107.7265291214
emissions: 0.0508948599019375
emissions_rate: 6.051151541269611e-07
cpu_power: 42.5
gpu_power: 0.0
ram_power: 3.75
cpu_energy: 0.992936073138814
gpu_energy: 0
ram_energy: 0.087611259230723
energy_consumed: 1.0805473323695376
country_name: Switzerland
country_iso_code: CHE
region: .nan
cloud_provider: .nan
cloud_region: .nan
os: Linux-5.14.0-70.30.1.el9_0.x86_64-x86_64-with-glibc2.34
python_version: 3.10.4
codecarbon_version: 2.3.4
cpu_count: 2
cpu_model: Intel(R) Xeon(R) Platinum 8360Y CPU @ 2.40GHz
gpu_count: .nan
gpu_model: .nan
longitude: .nan
latitude: .nan
ram_total_size: 10
tracking_mode: machine
on_cloud: N
pue: 1.0
---
## Environmental Impact (CODE CARBON DEFAULT)
| Metric | Value |
|--------------------------|---------------------------------|
| Duration (in seconds) | 84107.7265291214 |
| Emissions (Co2eq in kg) | 0.0508948599019375 |
| CPU power (W) | 42.5 |
| GPU power (W) | [No GPU] |
| RAM power (W) | 3.75 |
| CPU energy (kWh) | 0.992936073138814 |
| GPU energy (kWh) | [No GPU] |
| RAM energy (kWh) | 0.087611259230723 |
| Consumed energy (kWh) | 1.0805473323695376 |
| Country name | Switzerland |
| Cloud provider | nan |
| Cloud region | nan |
| CPU count | 2 |
| CPU model | Intel(R) Xeon(R) Platinum 8360Y CPU @ 2.40GHz |
| GPU count | nan |
| GPU model | nan |
## Environmental Impact (for one core)
| Metric | Value |
|--------------------------|---------------------------------|
| CPU energy (kWh) | 0.16190737356855872 |
| Emissions (Co2eq in kg) | 0.03294219289057255 |
## Note
21 May 2024
## My Config
| Config | Value |
|--------------------------|-----------------|
| checkpoint | damgomz/ThunBERT_bs16_lr5_MLM |
| model_name | ft_32_2e6_mlm_cv |
| sequence_length | 400 |
| num_epoch | 6 |
| learning_rate | 2e-06 |
| batch_size | 32 |
| weight_decay | 0.0 |
| warm_up_prop | 0.0 |
| drop_out_prob | 0.1 |
| packing_length | 100 |
| train_test_split | 0.2 |
| num_steps | 32586 |
## Training and Testing steps
Epoch | Train Loss | Test Loss | Accuracy | Recall
---|---|---|---|---
| 0 | 0.550419 | 0.454254 | 0.789185 | 0.851809 |
| 1 | 0.398037 | 0.372154 | 0.828961 | 0.864037 |
| 2 | 0.340236 | 0.356446 | 0.840012 | 0.875733 |
| 3 | 0.316593 | 0.345909 | 0.844725 | 0.860372 |
| 4 | 0.296352 | 0.345768 | 0.846199 | 0.849053 |
| 5 | 0.277707 | 0.347603 | 0.846936 | 0.864010 |
|