Hugging Face's logo

xiaol
/
rwkv-7B-world-novel-128k

Model card Files Community
2
xiaol commited on
Commit
eb818d2
•
1 Parent(s): 55faadc

Update README.md

Browse files

![SKBRT(IJ36`QS3CFWX15737.jpg](https://cdn-uploads.huggingface.co/production/uploads/6176b32847ee6431f632981e/yBe2qzSL5kuH244_7Faut.jpeg)

Files changed (1) hide show
  1. README.md +2 -3
README.md CHANGED
@@ -6,10 +6,9 @@ We proudly announce this is the world first 128k context model based on RWKV arc
6
  This model trained with instructions datasets and chinese web novel and tradition wuxia,
7
  more trainning details would be updated.
8
 
9
- Full finetuned using this repo to train 128k context model , 4*A800 40hours with 4B tokens.
10
  https://github.com/SynthiaDL/TrainChatGalRWKV/blob/main/train_world.sh
11
- ![QQ图片20230810144654.jpg](https://cdn-uploads.huggingface.co/production/uploads/6176b32847ee6431f632981e/KjeXNjryiZjKH0PsnrE6J.jpeg)
12
-
13
 
14
  Using RWKV Runner https://github.com/josStorer/RWKV-Runner to test this
15
 
 
6
  This model trained with instructions datasets and chinese web novel and tradition wuxia,
7
  more trainning details would be updated.
8
 
9
+ Full finetuned using this repo to train 128k context model , 4*A800 40hours with 1.3B tokens.
10
  https://github.com/SynthiaDL/TrainChatGalRWKV/blob/main/train_world.sh
11
+ ![SKBRT(IJ36`QS3CFWX15737.jpg](https://cdn-uploads.huggingface.co/production/uploads/6176b32847ee6431f632981e/yBe2qzSL5kuH244_7Faut.jpeg)
 
12
 
13
  Using RWKV Runner https://github.com/josStorer/RWKV-Runner to test this
14