Update README.md
Browse files
README.md
CHANGED
@@ -23,9 +23,9 @@
|
|
23 |
## ํ์ต ์์ธ
|
24 |
- **BATCH_SIZE**: 112 (GPU๋น)
|
25 |
- **ACCUMULATE**: 36
|
26 |
-
- **
|
27 |
- **MAX_STEPS**: 12,500
|
28 |
-
- **
|
29 |
- **WARMUP_STEPS**: 2,400
|
30 |
- **์ต์ ํ**: AdamW, LR 1e-3, BETA (0.9, 0.98), eps 1e-6
|
31 |
- **ํ์ต๋ฅ ๊ฐ์ **: linear
|
|
|
23 |
## ํ์ต ์์ธ
|
24 |
- **BATCH_SIZE**: 112 (GPU๋น)
|
25 |
- **ACCUMULATE**: 36
|
26 |
+
- **Total_BATCH_SIZE**: 8064
|
27 |
- **MAX_STEPS**: 12,500
|
28 |
+
- **TRAIN_STEPS * BATCH_SIZE**: **100M**
|
29 |
- **WARMUP_STEPS**: 2,400
|
30 |
- **์ต์ ํ**: AdamW, LR 1e-3, BETA (0.9, 0.98), eps 1e-6
|
31 |
- **ํ์ต๋ฅ ๊ฐ์ **: linear
|