JustinLin610 commited on
Commit
c4cbe4a
1 Parent(s): 680eeef

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -16,7 +16,7 @@ tags:
16
 
17
  Qwen1.5 is the beta version of Qwen2, a transformer-based decoder-only language model pretrained on a large amount of data. In comparison with the previous released Qwen, the improvements include:
18
 
19
- * 6 model sizes, including 0.5B, 1.8B, 4B, 7B, 14B, and 72B;
20
  * Significant performance improvement in human preference for chat models;
21
  * Multilingual support of both base and chat models;
22
  * Stable support of 32K context length for models of all sizes
 
16
 
17
  Qwen1.5 is the beta version of Qwen2, a transformer-based decoder-only language model pretrained on a large amount of data. In comparison with the previous released Qwen, the improvements include:
18
 
19
+ * 8 model sizes, including 0.5B, 1.8B, 4B, 7B, 14B, 32B and 72B dense models, and an MoE model of 14B with 2.7B activated;
20
  * Significant performance improvement in human preference for chat models;
21
  * Multilingual support of both base and chat models;
22
  * Stable support of 32K context length for models of all sizes