Update README.md
Browse files
README.md
CHANGED
|
@@ -16,6 +16,8 @@ tags:
|
|
| 16 |
|
| 17 |
> 🚧 Note: this repo is under construction 🚧
|
| 18 |
|
|
|
|
|
|
|
| 19 |
# **Llama-2-Ko** 🦙🇰🇷
|
| 20 |
|
| 21 |
Llama-2-Ko serves as an advanced iteration of Llama 2, benefiting from an expanded vocabulary and the inclusion of a Korean corpus in its further pretraining. Just like its predecessor, Llama-2-Ko operates within the broad range of generative text models that stretch from 7 billion to 70 billion parameters. This repository focuses on the 7B pretrained version, which is tailored to fit the Hugging Face Transformers format. For access to the other models, feel free to consult the index provided below.
|
|
|
|
| 16 |
|
| 17 |
> 🚧 Note: this repo is under construction 🚧
|
| 18 |
|
| 19 |
+
> Update @ 2023.10.19: Fix Tokenizer bug(space not applied when decoding) after `transforemrs>=4.34.0`
|
| 20 |
+
|
| 21 |
# **Llama-2-Ko** 🦙🇰🇷
|
| 22 |
|
| 23 |
Llama-2-Ko serves as an advanced iteration of Llama 2, benefiting from an expanded vocabulary and the inclusion of a Korean corpus in its further pretraining. Just like its predecessor, Llama-2-Ko operates within the broad range of generative text models that stretch from 7 billion to 70 billion parameters. This repository focuses on the 7B pretrained version, which is tailored to fit the Hugging Face Transformers format. For access to the other models, feel free to consult the index provided below.
|