File size: 2,293 Bytes
1e32d00 b442d1d 1e32d00 b442d1d 1e32d00 b442d1d 1e32d00 b442d1d 1e32d00 b442d1d 1e32d00 b442d1d 1e32d00 b442d1d 1e32d00 b442d1d 1e32d00 b442d1d 9949814 1e32d00 b442d1d 1e32d00 b442d1d 9949814 61fe08f 5133cc9 09cb2e0 31de88e c566412 e2ef169 cf5db15 7816afb a541b6f 57d5fdc 0bee87c c99a204 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 |
---
language: en
tags:
- fill-mask
---
## Environmental Impact (CODE CARBON DEFAULT)
| Metric | Value |
|--------------------------|---------------------------------|
| Duration (in seconds) | [More Information Needed] |
| Emissions (Co2eq in kg) | [More Information Needed] |
| CPU power (W) | [NO CPU] |
| GPU power (W) | [No GPU] |
| RAM power (W) | [More Information Needed] |
| CPU energy (kWh) | [No CPU] |
| GPU energy (kWh) | [No GPU] |
| RAM energy (kWh) | [More Information Needed] |
| Consumed energy (kWh) | [More Information Needed] |
| Country name | [More Information Needed] |
| Cloud provider | [No Cloud] |
| Cloud region | [No Cloud] |
| CPU count | [No CPU] |
| CPU model | [No CPU] |
| GPU count | [No GPU] |
| GPU model | [No GPU] |
## Environmental Impact (for one core)
| Metric | Value |
|--------------------------|---------------------------------|
| CPU energy (kWh) | [No CPU] |
| Emissions (Co2eq in kg) | [More Information Needed] |
## Note
23 May 2024
## My Config
| Config | Value |
|--------------------------|-----------------|
| checkpoint | albert-base-v2 |
| model_name | fp_bs64_lr5_x4 |
| sequence_length | 400 |
| num_epoch | 6 |
| learning_rate | 5e-05 |
| batch_size | 64 |
| weight_decay | 0.0 |
| warm_up_prop | 0.0 |
| drop_out_prob | 0.1 |
| packing_length | 100 |
| train_test_split | 0.2 |
| num_steps | 10278 |
## Training and Testing steps
Epoch | Train Loss | Test Loss
---|---|---
| 0.0 | 15.918249 | 9.392778 |
| 0.5 | 5.090525 | 4.007436 |
| 1.0 | 3.736158 | 3.569265 |
| 1.5 | 3.457080 | 3.366405 |
| 2.0 | 3.294382 | 3.235556 |
| 2.5 | 3.196004 | 3.175543 |
| 3.0 | 3.097808 | 3.081475 |
| 3.5 | 3.041380 | 3.029809 |
| 4.0 | 2.969532 | 2.984502 |
| 4.5 | 2.927619 | 2.950877 |
| 5.0 | 2.891346 | 2.897531 |
| 5.5 | 2.853556 | 2.867581 |
| 6.0 | 2.830631 | 2.856134 |
|