Trofish commited on
Commit
0ee90b1
β€’
1 Parent(s): e93a827

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +8 -3
README.md CHANGED
@@ -20,15 +20,20 @@
20
  총 ν•©μ‚°λœ λ°μ΄ν„°λŠ” μ•½ 11GB μž…λ‹ˆλ‹€.
21
 
22
  ## ν•™μŠ΅ 상세
23
- - **BATCH_SIZE**: 54 (GPUλ‹Ή)
24
- - **ACCUMULATE**: 74
25
  - **MAX_STEPS**: 12,500
26
- - **Train Steps*Batch Szie**: 100M
27
  - **WARMUP_STEPS**: 2,400
28
  - **μ΅œμ ν™”**: AdamW, LR 1e-3, BETA (0.9, 0.98), eps 1e-6
29
  - **ν•™μŠ΅λ₯  감쇠**: linear
30
  - **μ‚¬μš©λœ ν•˜λ“œμ›¨μ–΄**: 2x RTX 8000 GPU
31
 
 
 
 
 
 
32
  ## μ‚¬μš© 방법
33
  ```python
34
  from transformers import AutoModel, AutoTokenizer
 
20
  총 ν•©μ‚°λœ λ°μ΄ν„°λŠ” μ•½ 11GB μž…λ‹ˆλ‹€.
21
 
22
  ## ν•™μŠ΅ 상세
23
+ - **BATCH_SIZE**: 112 (GPUλ‹Ή)
24
+ - **ACCUMULATE**: 36
25
  - **MAX_STEPS**: 12,500
26
+ - **Train Steps*Batch Szie**: **100M**
27
  - **WARMUP_STEPS**: 2,400
28
  - **μ΅œμ ν™”**: AdamW, LR 1e-3, BETA (0.9, 0.98), eps 1e-6
29
  - **ν•™μŠ΅λ₯  감쇠**: linear
30
  - **μ‚¬μš©λœ ν•˜λ“œμ›¨μ–΄**: 2x RTX 8000 GPU
31
 
32
+
33
+ ![Evaluation Loss Graph](https://cdn-uploads.huggingface.co/production/uploads/64a0fd6fd3149e05bc5260dd/-64jKdcJAavwgUREwaywe.png)
34
+
35
+ ![Evaluation Accuracy Graph](https://cdn-uploads.huggingface.co/production/uploads/64a0fd6fd3149e05bc5260dd/LPq5M6S8LTwkFSCepD33S.png)
36
+
37
  ## μ‚¬μš© 방법
38
  ```python
39
  from transformers import AutoModel, AutoTokenizer