aseker00 commited on
Commit
99fa890
1 Parent(s): 8b36f5b

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -2
README.md CHANGED
@@ -45,9 +45,9 @@ To optimize training time we split the data into 4 sections based on max number
45
  3. 64 <= num tokens < 128 (10M sentences)
46
  4. 128 <= num tokens < 512 (70M sentences)
47
 
48
- Each section was trained for 5 epochs with an initial learning rate set to 1e-4.
49
 
50
- Total training time was 5 days.
51
 
52
  ## Eval
53
 
 
45
  3. 64 <= num tokens < 128 (10M sentences)
46
  4. 128 <= num tokens < 512 (70M sentences)
47
 
48
+ Each section was first trained for 5 epochs with an initial learning rate set to 1e-4. Then each second was trained for another 5 epochs with an initial learning rate set to 1e-5, for a total of 10 epochs.
49
 
50
+ Total training time was 8 days.
51
 
52
  ## Eval
53