We made a LLM model with yanolja/KoSOLAR-10.7B-v0.3
We use QLoRA(128, 32) and NEFTune on LLM Fine-tuning lr=1e-5
Our Korean data used, and 1 epoch train
We are making LLM model for Kolon !
