gwonny commited on
Commit
d2d2a58
1 Parent(s): 7740ff3

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -1
README.md CHANGED
@@ -9,7 +9,8 @@ language:
9
  We made a LLM model with davidkim205/nox-solar-10.7b-v4
10
 
11
  ## Model Description
12
- We use QLOR and NEFTune on LLM Fine-tuning
 
13
 
14
  ## Train Detail
15
  Our private data used, and 5 epoch train
 
9
  We made a LLM model with davidkim205/nox-solar-10.7b-v4
10
 
11
  ## Model Description
12
+ We use QLOR(64, 16) and NEFTune on LLM Fine-tuning
13
+ lr = 2e-4,
14
 
15
  ## Train Detail
16
  Our private data used, and 5 epoch train