miguelcarv commited on
Commit
9790910
1 Parent(s): 3537a63

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -45,7 +45,7 @@ print(tokenizer.decode(outputs[0], skip_special_tokens=True))
45
 
46
  - Trained for one epoch on SlimOrca-Dedup
47
  - Learning rate: 1e-5
48
- - Cosine learning rate decay to 0
49
  - Optimizer: AdamW
50
  - Batch size: 256
51
  - Trained with FP32
 
45
 
46
  - Trained for one epoch on SlimOrca-Dedup
47
  - Learning rate: 1e-5
48
+ - Cosine learning rate decay
49
  - Optimizer: AdamW
50
  - Batch size: 256
51
  - Trained with FP32