CHIH-HUNG
/

llama-2-13b-OpenOrca_20w

Text Generation

Inference Endpoints

text-generation-inference

Model card Files Files and versions Community

CHIH-HUNG commited on Sep 1, 2023

Commit

94ddbc1

•

1 Parent(s): ce1632e

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -14,7 +14,7 @@ datasets:
 - **model:** meta-llama/Llama-2-13b-hf
 - **dataset:** Open-Orca/OpenOrca (取前20w筆訓練集)
 - **peft_type:** LoRA
-- **lora_target:** q_proj,v_proj
 - **per_device_train_batch_size:** 8
 - **gradient_accumulation_steps:** 8
 - **learning_rate :** 5e-5

 - **model:** meta-llama/Llama-2-13b-hf
 - **dataset:** Open-Orca/OpenOrca (取前20w筆訓練集)
 - **peft_type:** LoRA
+- **lora_target:** q_proj, v_proj
 - **per_device_train_batch_size:** 8
 - **gradient_accumulation_steps:** 8
 - **learning_rate :** 5e-5