Update README.md
Browse files
README.md
CHANGED
|
@@ -14,6 +14,7 @@ datasets:
|
|
| 14 |
- **model:** meta-llama/Llama-2-13b-hf
|
| 15 |
- **dataset:** Open-Orca/OpenOrca (取前20w筆訓練集)
|
| 16 |
- **peft_type:** LoRA
|
|
|
|
| 17 |
- **lora_target:** q_proj, v_proj
|
| 18 |
- **per_device_train_batch_size:** 8
|
| 19 |
- **gradient_accumulation_steps:** 8
|
|
|
|
| 14 |
- **model:** meta-llama/Llama-2-13b-hf
|
| 15 |
- **dataset:** Open-Orca/OpenOrca (取前20w筆訓練集)
|
| 16 |
- **peft_type:** LoRA
|
| 17 |
+
- **lora_rank:** 8
|
| 18 |
- **lora_target:** q_proj, v_proj
|
| 19 |
- **per_device_train_batch_size:** 8
|
| 20 |
- **gradient_accumulation_steps:** 8
|