Update README.md
Browse files
README.md
CHANGED
|
@@ -1,3 +1,7 @@
|
|
| 1 |
---
|
| 2 |
license: llama2
|
| 3 |
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
---
|
| 2 |
license: llama2
|
| 3 |
---
|
| 4 |
+
|
| 5 |
+
# Llama 2 13B with End-of-turn (EOT) Token
|
| 6 |
+
|
| 7 |
+
This is the Llama 2 13B model with `<|end_of_turn|>` token added as id `32000` and `<|PAD|>` as id `32001`. The token input/output embedding is initialized as the mean of all existing input/output token embeddings, respectively.
|