Commit History

Add ~58B tokens ckpt
34bec76

beomi commited on

Merge branch 'main' of https://huggingface.co/beomi/KoRWKV-1.5B
1a86367

beomi commited on

Add 1.3M ckpt(= 42B tokens)
1845fad

beomi commited on

Update README.md
45f13af

beomi commited on

Update README.md
74f5aab

beomi commited on

Add 956k step(=31.3B tokens) ckpt
8aa951c

beomi commited on

RNN can extrapolate to Unlimited context
376b4bf

beomi commited on

update to 810k step(~=26.5B tokens
8f704cc

beomi commited on

edit weight keys
88a12b7

beomi commited on

update
ed167a2

beomi commited on

Add original ckpt for RWKV code
c99f77f

beomi commited on

Update README.md
773fcc4

beomi commited on

Merge branch 'main' of https://huggingface.co/beomi/KoRWKV-1.5B
6121b22

beomi commited on

Add 635k (20.8B tokens) step ckpt
b3ac395

beomi commited on

Update README.md
7496177

beomi commited on

Add 15.4B tokens(470k steps)
d7b24f7

beomi commited on

test
882a7f8

beomi commited on

Update README.md
3503544

beomi commited on

initial commit
717a5e3

beomi commited on