File size: 296 Bytes
44c77f1 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 |
---
license: cc-by-nc-4.0
language:
- ko
- en
---
## Base Model:
We made a LLM model with meta-llama/Meta-Llama-3-8B
## Model Description
We use QDoRA(256, 64) and lr=1e-5, NEFTune=3
## Train Detail
Our changed private data used, and 5 epoch train
## Others
We are making LLM model for Kolon ! |