Commit
•
4ceff8d
1
Parent(s):
2f5718d
Update README.md
Browse files
README.md
CHANGED
@@ -48,7 +48,7 @@ The following shows the progression of the model from 1.1T trained to 2.25T trai
|
|
48 |
|
49 |
Compared against other top performing models in the same weight class.
|
50 |
|
51 |
-
|Model |
|
52 |
|----------------------|---------------|----------------|-------------|---------------|---------------|
|
53 |
|Param Count |6.89 B |6.92 B |6.74 B |7.52 B |7.24 B |
|
54 |
|Tokens Trained |2.5 T |1.5 T |2 T |2.25 T |2 - 7 T? |
|
@@ -254,9 +254,15 @@ User: 乌兰察布
|
|
254 |
Assistant: 乌兰察布是中国新疆维吾尔自治区的一个县级市,位于新疆维吾尔自治区中部,是新疆的第二大城市。乌兰察布市是新疆的第一大城市,也是新疆的重要城市之一。乌兰察布市是新疆的经济中心,也是新疆的重要交通枢纽之一。乌兰察布市的人口约为2.5万人,其中汉族占绝大多数。乌
|
255 |
```
|
256 |
|
|
|
|
|
|
|
|
|
|
|
|
|
257 |
## Acknowledgement
|
258 |
We are grateful for the help and support from the following key groups:
|
259 |
|
260 |
- [Recursal.ai](https://recursal.ai) team for financing the GPU resources, and managing the training of this foundation model - you can run the Eagle line of RWKV models on their cloud / on-premise platform today.
|
261 |
- EleutherAI for their support, especially in the v5/v6 Eagle/Finch paper
|
262 |
-
- Linux Foundation AI & Data group for supporting and hosting the RWKV project
|
|
|
48 |
|
49 |
Compared against other top performing models in the same weight class.
|
50 |
|
51 |
+
|Model |OLMo-7B |falcon-7b |Llama-2-7b-hf|EagleX-7B-HF-v2|Mistral-7B-v0.1|
|
52 |
|----------------------|---------------|----------------|-------------|---------------|---------------|
|
53 |
|Param Count |6.89 B |6.92 B |6.74 B |7.52 B |7.24 B |
|
54 |
|Tokens Trained |2.5 T |1.5 T |2 T |2.25 T |2 - 7 T? |
|
|
|
254 |
Assistant: 乌兰察布是中国新疆维吾尔自治区的一个县级市,位于新疆维吾尔自治区中部,是新疆的第二大城市。乌兰察布市是新疆的第一大城市,也是新疆的重要城市之一。乌兰察布市是新疆的经济中心,也是新疆的重要交通枢纽之一。乌兰察布市的人口约为2.5万人,其中汉族占绝大多数。乌
|
255 |
```
|
256 |
|
257 |
+
## Links
|
258 |
+
- [Our wiki](https://wiki.rwkv.com)
|
259 |
+
- [Full eval data](https://docs.google.com/spreadsheets/d/1CBLU6yKkW-8FMvGD4INO3qjeHZ0qkKnZFcM6n6lWNOs/edit#gid=912381775)
|
260 |
+
- [RecursalAI Online Platform](https://recursal.ai)
|
261 |
+
- [HF Demo (todo)](###)
|
262 |
+
|
263 |
## Acknowledgement
|
264 |
We are grateful for the help and support from the following key groups:
|
265 |
|
266 |
- [Recursal.ai](https://recursal.ai) team for financing the GPU resources, and managing the training of this foundation model - you can run the Eagle line of RWKV models on their cloud / on-premise platform today.
|
267 |
- EleutherAI for their support, especially in the v5/v6 Eagle/Finch paper
|
268 |
+
- Linux Foundation AI & Data group for supporting and hosting the RWKV project
|