license: cc-by-nc-4.0 | |
language: | |
- ko | |
- en | |
## Base Model: | |
We made a LLM model with davidkim205/nox-solar-10.7b-v4 | |
## Model Description | |
We use QLoRA(64, 16) and NEFTune on LLM Fine-tuning | |
lr = 2e-4 | |
## Train Detail | |
Our private data used, and 10 epoch train | |
## Others | |
We are making LLM model for Kolon ! |