File size: 2,237 Bytes
0393952 086591c 0393952 086591c 0393952 086591c 0393952 086591c 0393952 086591c 0393952 086591c 0393952 086591c 0393952 086591c 0393952 086591c 0393952 086591c 0393952 086591c 13feff6 1e35088 349ca07 eae8613 e8f3f04 9452e83 5f8d69d db8fbeb 0597733 555343e |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 |
---
language: en
tags:
- fill-mask
---
## Environmental Impact (CODE CARBON DEFAULT)
| Metric | Value |
|--------------------------|---------------------------------|
| Duration (in seconds) | [More Information Needed] |
| Emissions (Co2eq in kg) | [More Information Needed] |
| CPU power (W) | [NO CPU] |
| GPU power (W) | [No GPU] |
| RAM power (W) | [More Information Needed] |
| CPU energy (kWh) | [No CPU] |
| GPU energy (kWh) | [No GPU] |
| RAM energy (kWh) | [More Information Needed] |
| Consumed energy (kWh) | [More Information Needed] |
| Country name | [More Information Needed] |
| Cloud provider | [No Cloud] |
| Cloud region | [No Cloud] |
| CPU count | [No CPU] |
| CPU model | [No CPU] |
| GPU count | [No GPU] |
| GPU model | [No GPU] |
## Environmental Impact (for one core)
| Metric | Value |
|--------------------------|---------------------------------|
| CPU energy (kWh) | [No CPU] |
| Emissions (Co2eq in kg) | [More Information Needed] |
## Note
30 April 2024
## My Config
| Config | Value |
|--------------------------|-----------------|
| checkpoint | albert-base-v2 |
| model_name | BERTrand_bs32_lr5 |
| sequence_length | 400 |
| num_epoch | 12 |
| learning_rate | 5e-05 |
| batch_size | 32 |
| weight_decay | 0.0 |
| warm_up_prop | 0 |
| drop_out_prob | 0.1 |
| packing_length | 100 |
| train_test_split | 0.2 |
| num_steps | 6287 |
## Training and Testing steps
Epoch | Train Loss | Test Loss
---|---|---
| 0.0 | 15.495780 | 13.831327 |
| 0.5 | 7.825472 | 7.840593 |
| 1.0 | 7.327533 | 7.785610 |
| 1.5 | 7.205367 | 7.586150 |
| 2.0 | 7.151769 | 7.663743 |
| 2.5 | 7.125600 | 8.101605 |
| 3.0 | 7.034717 | 7.773854 |
| 3.5 | 7.092155 | 7.549316 |
| 4.0 | 7.067814 | 7.819034 |
| 4.5 | 7.141888 | 7.587213 |
| 5.0 | 7.006890 | 7.892200 |
|