beomi commited on
Commit
fe63b04
β€’
1 Parent(s): 203c84a

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +9 -7
README.md CHANGED
@@ -7,19 +7,21 @@ tags:
7
  - KoRWKV
8
  ---
9
 
10
- > 🚧 Note: this repo is under construction, current uploaded version is ~70% trained ckpt (with >100Billion tokens) 🚧
11
- >
12
  > Instruction-Finetuned model is available at [beomi/KoAlpaca-KoRWKV-1.5B](https://huggingface.co/beomi/KoAlpaca-KoRWKV-1.5B)
13
 
14
  ## Todo
15
 
16
- - ⏳ Train 1.5B
17
- - Todo: Train Bigger Models
 
 
18
 
19
 
20
  # KoRWKV Model Card
21
 
22
- KoRWKV (1.5B) trained on Korean dataset with RWKVv4 Neo Architecture.
23
 
24
  ## Model details
25
 
@@ -29,11 +31,11 @@ Junbum Lee (aka Beomi)
29
 
30
  **Model date**
31
 
32
- KoRWKV was trained between 2022.05~
33
 
34
  **Model version**
35
 
36
- This is alpha version of the model.
37
 
38
  **Model type**
39
 
 
7
  - KoRWKV
8
  ---
9
 
10
+ > Train finished πŸŽ‰πŸŽ‰ This version is **beta** release of KoRWKV-1.5B
11
+ >
12
  > Instruction-Finetuned model is available at [beomi/KoAlpaca-KoRWKV-1.5B](https://huggingface.co/beomi/KoAlpaca-KoRWKV-1.5B)
13
 
14
  ## Todo
15
 
16
+ - βœ… Train 1.5B
17
+ - βœ… Beta Release (Full data train)
18
+ - ⏳ Final Release (Full data train + Curated data train)
19
+ - ⏳ Train Bigger Models (6B)
20
 
21
 
22
  # KoRWKV Model Card
23
 
24
+ KoRWKV (1.5B params) trained on Korean dataset with RWKVv4 Neo Architecture.
25
 
26
  ## Model details
27
 
 
31
 
32
  **Model date**
33
 
34
+ KoRWKV was trained between 2022.05~2022.06
35
 
36
  **Model version**
37
 
38
+ This is beta version of the model.
39
 
40
  **Model type**
41