Experiment Objectives
- Is Training with Korean + Multi-lingual dataset helpful to perform Korean benchmarks?
- Does Full Parameter Depth-Up Scaled Training (expansion method: Llama-Pro) help to perform the best Korean benchmark performance?
Methods
- Training CJK + En + Glot dataset with the same ratio of data size.
- Layer Expansion and full parameter training.
- Downloads last month
- 4
Unable to determine this model's library. Check the
docs
.