beomi commited on
Commit
4851758
β€’
1 Parent(s): 56c1f44

Finish LM train validation on minimal dataset

Browse files
Files changed (1) hide show
  1. README.md +3 -3
README.md CHANGED
@@ -25,9 +25,9 @@ tags:
25
  - βœ… Train new BBPE Tokenizer
26
  - βœ… Test train code on TPUv4 Pods (with model parallel)
27
  - βœ… Converting test (jax to PyTorch)
28
- - ⏳ LM train validation on minimal dataset (1 sentence 1000 step)
29
- - Build Data Shuffler (curriculum learning)
30
- - Train 7B Model
31
  - Train 13B Model
32
  - Train 33B Model
33
  - Train 65B Model
 
25
  - βœ… Train new BBPE Tokenizer
26
  - βœ… Test train code on TPUv4 Pods (with model parallel)
27
  - βœ… Converting test (jax to PyTorch)
28
+ - βœ… LM train validation on minimal dataset (1 sentence 1000 step)
29
+ - ⏳ Build Data Shuffler (curriculum learning)
30
+ - ⏳ Train 7B Model
31
  - Train 13B Model
32
  - Train 33B Model
33
  - Train 65B Model