norabelrose commited on
Commit
285feaf
1 Parent(s): f4b751a

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -5,7 +5,7 @@ datasets:
5
  language:
6
  - en
7
  ---
8
- This is an RWKV-v5 ("Eagle") RNN language model pretrained on 7B of multi-lingual data and fine-tuned on Nous Research's OpenHermes 2.5 chat dataset.
9
 
10
  The chat format is identical to the default HuggingFace format, **EXCEPT** that we replace the `<|im_start|>` and `<|im_end|>` special tokens with the unused ASCII codes `"\x16"` and `"\x17"` respectively. This was done to ensure complete compatibility withe standard RWKV World tokenizer.
11
 
 
5
  language:
6
  - en
7
  ---
8
+ This is a 7B parameter RWKV-v5 ("Eagle") RNN language model pretrained on over 1T tokens of multi-lingual data and fine-tuned on Nous Research's OpenHermes 2.5 chat dataset.
9
 
10
  The chat format is identical to the default HuggingFace format, **EXCEPT** that we replace the `<|im_start|>` and `<|im_end|>` special tokens with the unused ASCII codes `"\x16"` and `"\x17"` respectively. This was done to ensure complete compatibility withe standard RWKV World tokenizer.
11