OpenMOSE
/

RWKV-x060-Japanese-2.0B

Model card Files Files and versions Community

OpenMOSE commited on Apr 23, 2024

Commit

b833019

·

verified ·

1 Parent(s): 1bb557d

Update README.md

Files changed (1) hide show

README.md +1 -0

README.md CHANGED Viewed

@@ -15,5 +15,6 @@
 ## Training
    - using RWKV-LM-LISA Anarchy mode, Continuous Pre-traning
    - https://github.com/OpenMOSE/RWKV-LM-LISA
 2024 OpenMOSE

 ## Training
    - using RWKV-LM-LISA Anarchy mode, Continuous Pre-traning
    - https://github.com/OpenMOSE/RWKV-LM-LISA
+   - After 20epoch Changed LISA Mode 8layer/step to 4layer/step
 2024 OpenMOSE