Update README.md
Browse files
README.md
CHANGED
@@ -14,6 +14,7 @@ datasets:
|
|
14 |
- **model:** meta-llama/Llama-2-13b-hf
|
15 |
- **dataset:** garage-bAInd/Open-Platypus (共約2.5w筆訓練集) + ccp (約1200筆)
|
16 |
- **peft_type:** LoRA
|
|
|
17 |
- **lora_target:** gate_proj, up_proj, down_proj
|
18 |
- **per_device_train_batch_size:** 8
|
19 |
- **gradient_accumulation_steps:** 8
|
|
|
14 |
- **model:** meta-llama/Llama-2-13b-hf
|
15 |
- **dataset:** garage-bAInd/Open-Platypus (共約2.5w筆訓練集) + ccp (約1200筆)
|
16 |
- **peft_type:** LoRA
|
17 |
+
- **lora_rank:** 8
|
18 |
- **lora_target:** gate_proj, up_proj, down_proj
|
19 |
- **per_device_train_batch_size:** 8
|
20 |
- **gradient_accumulation_steps:** 8
|