File size: 564 Bytes
df56f9c de5d3da 62e4ab4 df56f9c a1f41d9 83e8d74 ec970ed 9abe758 e680763 ac9e695 bd3de7b |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 |
---
language: en
license: mit
library_name: pytorch
---
# Knowledge Continuity Regularized Network
Trainer Hyperparameters:
- `lr` = 1e-05
- `per_device_batch_size` = 8
- `gradient_accumulation_steps` = 2
- `weight_decay` = 1e-09
- `seed` = 42
Regularization Hyperparameters
- `numerical stability denominator constant` = 0.01
- `lambda` = 0.001
- `alpha` = 2.0
- `beta` = 1.0
Extended Logs:
|eval_loss|eval_accuracy|epoch|
|--|--|--|
|5.407|0.792|1.0|
|5.131|0.792|2.0|
|4.966|0.792|3.0|
|4.796|0.792|4.0|
|4.710|0.792|5.0|
|4.653|0.792|6.0|
|4.534|0.792|7.0|
|