metadata
license: cc-by-nc-sa-4.0
Experiment Objectives
- Is Training with Korean + Multi-lingual dataset helpful to perform Korean benchmarks?
- Does Full Parameter Depth-Up Scaled Training (expansion method: Llama-Pro) help to perform the best Korean benchmark performance?
Methods
- Training CJK + En + Glot dataset with the same ratio of data size.
- Layer Expansion and full parameter training.