lucas-meyer commited on
Commit
0da373d
1 Parent(s): 0303992

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -2
README.md CHANGED
@@ -41,8 +41,8 @@ The following hyperparameters were used during training:
41
  - train_batch_size: 4
42
  - eval_batch_size: 4
43
  - seed: 42
44
- - gradient_accumulation_steps: 2
45
- - total_train_batch_size: 8
46
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
47
  - lr_scheduler_type: linear
48
  - lr_scheduler_warmup_steps: 500
 
41
  - train_batch_size: 4
42
  - eval_batch_size: 4
43
  - seed: 42
44
+ - gradient_accumulation_steps: 3
45
+ - total_train_batch_size: 12
46
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
47
  - lr_scheduler_type: linear
48
  - lr_scheduler_warmup_steps: 500