Which languages are used in the dataset?
#1
by
WajihUllahBaig
- opened
Hey, thanks for such a wonderful model. Really loved it for the speed.
I was wondering what is the language distribution that you are training rwkv-5-world on now.
New dataset under preparation. The first 0.1B model uses the same dataset as RWKV-4-World.
Thanks for the reply. Appreciate it.
Nice to know that you are training RWKV, is it possible to know when you shall be releasing the new model?
Just one technical question, what sort of compute are you using to train the model? Would love to know this.
Join Discord and watch the RWKV-5 channel
Sure thanks