| license: cc-by-nc-4.0 | |
| language: | |
| - ko | |
| - en | |
| ## Base Model: | |
| We made a LLM model with davidkim205/nox-solar-10.7b-v4 | |
| ## Model Description | |
| We use QLOR(64, 16) and NEFTune on LLM Fine-tuning | |
| lr = 2e-4, | |
| ## Train Detail | |
| Our private data used, and 5 epoch train | |
| ## Others | |
| We are making LLM model for Kolon ! |