Create README.md
Browse files
README.md
ADDED
@@ -0,0 +1,10 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
---
|
2 |
+
license: other
|
3 |
+
language:
|
4 |
+
- en
|
5 |
+
pipeline_tag: text-generation
|
6 |
+
---
|
7 |
+
|
8 |
+
# LLaMA 13B with End-of-turn (EOT) Token
|
9 |
+
|
10 |
+
This is the LLaMA 13B model with `<|end_of_turn|>` token added as id `32000`. The token input/output embedding is initialized as the mean of all existing input/output token embeddings, respectively.
|