wenge-research
/

yayi2-30b

Text Generation

Model card Files Files and versions Community

wenge-research commited on Dec 15, 2023

Commit

4f301cb

•

1 Parent(s): 403cc63

Update README.md

Files changed (1) hide show

README.md +2 -2

README.md CHANGED Viewed

@@ -33,8 +33,8 @@ For more details about the YAYI 2, please refer to our GitHub repository. Stay t
 |:----------|:----------:|
 | n_layers | 64    |
 | n_heads | 64    |
-| d_model | 16384    |
-| vocab size | 81920    |
 | sequence length | 4096    |

 |:----------|:----------:|
 | n_layers | 64    |
 | n_heads | 64    |
+| hidden_size | 7168    |
+| vocab_size | 81920    |
 | sequence length | 4096    |