JustinLin610
commited on
Commit
•
c4cbe4a
1
Parent(s):
680eeef
Update README.md
Browse files
README.md
CHANGED
@@ -16,7 +16,7 @@ tags:
|
|
16 |
|
17 |
Qwen1.5 is the beta version of Qwen2, a transformer-based decoder-only language model pretrained on a large amount of data. In comparison with the previous released Qwen, the improvements include:
|
18 |
|
19 |
-
*
|
20 |
* Significant performance improvement in human preference for chat models;
|
21 |
* Multilingual support of both base and chat models;
|
22 |
* Stable support of 32K context length for models of all sizes
|
|
|
16 |
|
17 |
Qwen1.5 is the beta version of Qwen2, a transformer-based decoder-only language model pretrained on a large amount of data. In comparison with the previous released Qwen, the improvements include:
|
18 |
|
19 |
+
* 8 model sizes, including 0.5B, 1.8B, 4B, 7B, 14B, 32B and 72B dense models, and an MoE model of 14B with 2.7B activated;
|
20 |
* Significant performance improvement in human preference for chat models;
|
21 |
* Multilingual support of both base and chat models;
|
22 |
* Stable support of 32K context length for models of all sizes
|