Trofish commited on
Commit
94679f8
โ€ข
1 Parent(s): 1d87bea

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -2
README.md CHANGED
@@ -23,9 +23,9 @@
23
  ## ํ•™์Šต ์ƒ์„ธ
24
  - **BATCH_SIZE**: 112 (GPU๋‹น)
25
  - **ACCUMULATE**: 36
26
- - **Total_Batch_Szie**: 8064
27
  - **MAX_STEPS**: 12,500
28
- - **Train_Steps * Batch_Szie**: **100M**
29
  - **WARMUP_STEPS**: 2,400
30
  - **์ตœ์ ํ™”**: AdamW, LR 1e-3, BETA (0.9, 0.98), eps 1e-6
31
  - **ํ•™์Šต๋ฅ  ๊ฐ์‡ **: linear
 
23
  ## ํ•™์Šต ์ƒ์„ธ
24
  - **BATCH_SIZE**: 112 (GPU๋‹น)
25
  - **ACCUMULATE**: 36
26
+ - **Total_BATCH_SIZE**: 8064
27
  - **MAX_STEPS**: 12,500
28
+ - **TRAIN_STEPS * BATCH_SIZE**: **100M**
29
  - **WARMUP_STEPS**: 2,400
30
  - **์ตœ์ ํ™”**: AdamW, LR 1e-3, BETA (0.9, 0.98), eps 1e-6
31
  - **ํ•™์Šต๋ฅ  ๊ฐ์‡ **: linear