gwonny commited on
Commit
766b7c8
1 Parent(s): f2bdf8e

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +18 -0
README.md ADDED
@@ -0,0 +1,18 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: cc-by-nc-4.0
3
+ language:
4
+ - ko
5
+ - en
6
+ ---
7
+
8
+ ## Base Model:
9
+ We made a LLM model with davidkim205/nox-solar-10.7b-v4
10
+
11
+ ## Model Description
12
+ We use QDoRA(256, 64) and NEFTune on LLM Fine-tuning lr = 1e-5, NEFTune = 5
13
+
14
+ ## Train Detail
15
+ Our changed private data used, 5 epoch train, and parameter changed
16
+
17
+ ## Others
18
+ We are making LLM model for Kolon !