Minor change in README
Browse files
README.md
CHANGED
@@ -33,7 +33,7 @@ The model was pre-trained on various Korean web-crawled datasets openly availabl
|
|
33 |
|
34 |
### Clarification on "Pre-trained"
|
35 |
|
36 |
-
It's essential to understand what "pre-trained" means in the context of this model. While the base model was already pre-trained on a
|
37 |
|
38 |
### Training Hyperparameters
|
39 |
|
|
|
33 |
|
34 |
### Clarification on "Pre-trained"
|
35 |
|
36 |
+
It's essential to understand what "pre-trained" means in the context of this model. While the base model was already pre-trained on a broad, non-task-specific corpus of data, we further pre-trained only the embeddings for the expanded Korean vocabulary. This means that we did not alter the other existing parameters from the base model at all. This approach ensures a robust understanding of both English and Korean.
|
37 |
|
38 |
### Training Hyperparameters
|
39 |
|