picocreator commited on
Commit
4ceff8d
1 Parent(s): 2f5718d

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +8 -2
README.md CHANGED
@@ -48,7 +48,7 @@ The following shows the progression of the model from 1.1T trained to 2.25T trai
48
 
49
  Compared against other top performing models in the same weight class.
50
 
51
- |Model |allenai/OLMo-7B|tiiuae/falcon-7b|Llama-2-7b-hf|EagleX-7B-HF-v2|Mistral-7B-v0.1|
52
  |----------------------|---------------|----------------|-------------|---------------|---------------|
53
  |Param Count |6.89 B |6.92 B |6.74 B |7.52 B |7.24 B |
54
  |Tokens Trained |2.5 T |1.5 T |2 T |2.25 T |2 - 7 T? |
@@ -254,9 +254,15 @@ User: 乌兰察布
254
  Assistant: 乌兰察布是中国新疆维吾尔自治区的一个县级市,位于新疆维吾尔自治区中部,是新疆的第二大城市。乌兰察布市是新疆的第一大城市,也是新疆的重要城市之一。乌兰察布市是新疆的经济中心,也是新疆的重要交通枢纽之一。乌兰察布市的人口约为2.5万人,其中汉族占绝大多数。乌
255
  ```
256
 
 
 
 
 
 
 
257
  ## Acknowledgement
258
  We are grateful for the help and support from the following key groups:
259
 
260
  - [Recursal.ai](https://recursal.ai) team for financing the GPU resources, and managing the training of this foundation model - you can run the Eagle line of RWKV models on their cloud / on-premise platform today.
261
  - EleutherAI for their support, especially in the v5/v6 Eagle/Finch paper
262
- - Linux Foundation AI & Data group for supporting and hosting the RWKV project
 
48
 
49
  Compared against other top performing models in the same weight class.
50
 
51
+ |Model |OLMo-7B |falcon-7b |Llama-2-7b-hf|EagleX-7B-HF-v2|Mistral-7B-v0.1|
52
  |----------------------|---------------|----------------|-------------|---------------|---------------|
53
  |Param Count |6.89 B |6.92 B |6.74 B |7.52 B |7.24 B |
54
  |Tokens Trained |2.5 T |1.5 T |2 T |2.25 T |2 - 7 T? |
 
254
  Assistant: 乌兰察布是中国新疆维吾尔自治区的一个县级市,位于新疆维吾尔自治区中部,是新疆的第二大城市。乌兰察布市是新疆的第一大城市,也是新疆的重要城市之一。乌兰察布市是新疆的经济中心,也是新疆的重要交通枢纽之一。乌兰察布市的人口约为2.5万人,其中汉族占绝大多数。乌
255
  ```
256
 
257
+ ## Links
258
+ - [Our wiki](https://wiki.rwkv.com)
259
+ - [Full eval data](https://docs.google.com/spreadsheets/d/1CBLU6yKkW-8FMvGD4INO3qjeHZ0qkKnZFcM6n6lWNOs/edit#gid=912381775)
260
+ - [RecursalAI Online Platform](https://recursal.ai)
261
+ - [HF Demo (todo)](###)
262
+
263
  ## Acknowledgement
264
  We are grateful for the help and support from the following key groups:
265
 
266
  - [Recursal.ai](https://recursal.ai) team for financing the GPU resources, and managing the training of this foundation model - you can run the Eagle line of RWKV models on their cloud / on-premise platform today.
267
  - EleutherAI for their support, especially in the v5/v6 Eagle/Finch paper
268
+ - Linux Foundation AI & Data group for supporting and hosting the RWKV project