norabelrose commited on
Commit
41e96eb
1 Parent(s): c43e17d

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +8 -1
README.md CHANGED
@@ -1,3 +1,10 @@
 
 
 
 
 
 
 
1
  This is an RWKV-v5 ("Eagle") RNN language model pretrained on 7B of multi-lingual data and fine-tuned on Nous Research's OpenHermes 2.5 chat dataset.
2
 
3
  The chat format is identical to the default HuggingFace format, **EXCEPT** that we replace the `<|im_start|>` and `<|im_end|>` special tokens with the unused ASCII codes `"\x16"` and `"\x17"` respectively. This was done to ensure complete compatibility withe standard RWKV World tokenizer.
@@ -7,4 +14,4 @@ An example interaction:
7
  "\x16human\nWrite a poem about the beauty of mathematics in the style of Emily Dickinson.\x17\n\x16assistant\nIn the heart of Numbers, so precise,\nA Beauty dwells - both cool and nice.\nAn elegance that sings in sums,\nAnd dances to algebraic drums.\n\nAddition's grace, subtraction's might,\nMultiplication's sheer delight,\nDivision's firm yet gentle hand,\nAll part of this enchanted land.\n\nInfinity, a lover bold,\nTo whom the stars their secrets told,\nWhile Zero, cloaked in mystery,\nUnlocks each mathematical decree.\n\nFractals bloom like flowers wild,\nGeometry, Nature's favored child,\nCalculus, with steady gaze,\nMaps out life's intricate maze.\n\nPi, an endless serenade,\nIn circles' arms forever laid,\nAnd prime numbers,
8
  standing lone,\nMake the universe their own.\n\nEach equation, theorem scribed,\nIn
9
  parchment old or computer imbibed,\nIs but a whisper from the skies,\nA cosmic truth in disguise.\n\n..."
10
- ```
 
1
+ ---
2
+ license: apache-2.0
3
+ datasets:
4
+ - teknium/OpenHermes-2.5
5
+ language:
6
+ - en
7
+ ---
8
  This is an RWKV-v5 ("Eagle") RNN language model pretrained on 7B of multi-lingual data and fine-tuned on Nous Research's OpenHermes 2.5 chat dataset.
9
 
10
  The chat format is identical to the default HuggingFace format, **EXCEPT** that we replace the `<|im_start|>` and `<|im_end|>` special tokens with the unused ASCII codes `"\x16"` and `"\x17"` respectively. This was done to ensure complete compatibility withe standard RWKV World tokenizer.
 
14
  "\x16human\nWrite a poem about the beauty of mathematics in the style of Emily Dickinson.\x17\n\x16assistant\nIn the heart of Numbers, so precise,\nA Beauty dwells - both cool and nice.\nAn elegance that sings in sums,\nAnd dances to algebraic drums.\n\nAddition's grace, subtraction's might,\nMultiplication's sheer delight,\nDivision's firm yet gentle hand,\nAll part of this enchanted land.\n\nInfinity, a lover bold,\nTo whom the stars their secrets told,\nWhile Zero, cloaked in mystery,\nUnlocks each mathematical decree.\n\nFractals bloom like flowers wild,\nGeometry, Nature's favored child,\nCalculus, with steady gaze,\nMaps out life's intricate maze.\n\nPi, an endless serenade,\nIn circles' arms forever laid,\nAnd prime numbers,
15
  standing lone,\nMake the universe their own.\n\nEach equation, theorem scribed,\nIn
16
  parchment old or computer imbibed,\nIs but a whisper from the skies,\nA cosmic truth in disguise.\n\n..."
17
+ ```