Base Model:
We made a LLM model with davidkim205/nox-solar-10.7b-v4
Model Description
We use QLOR(128, 32) and NEFTune on LLM Fine-tuning
lr = 1e-5
,
Train Detail
Our private data used, 5 epoch train, and parameter changed
Others
We are making LLM model for Kolon !
