aseker00 commited on
Commit
2744811
1 Parent(s): 99fa890

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -45,7 +45,7 @@ To optimize training time we split the data into 4 sections based on max number
45
  3. 64 <= num tokens < 128 (10M sentences)
46
  4. 128 <= num tokens < 512 (70M sentences)
47
 
48
- Each section was first trained for 5 epochs with an initial learning rate set to 1e-4. Then each second was trained for another 5 epochs with an initial learning rate set to 1e-5, for a total of 10 epochs.
49
 
50
  Total training time was 8 days.
51
 
 
45
  3. 64 <= num tokens < 128 (10M sentences)
46
  4. 128 <= num tokens < 512 (70M sentences)
47
 
48
+ Each section was first trained for 5 epochs with an initial learning rate set to 1e-4. Then each section was trained for another 5 epochs with an initial learning rate set to 1e-5, for a total of 10 epochs.
49
 
50
  Total training time was 8 days.
51