Saxo
/

yunsung-llama-2-koen-13b-linkbricks-sft-basic-v1

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

Saxo commited on Mar 12, 2024

Commit

d1bfdf5

·

verified ·

1 Parent(s): 9bf3e2d

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -37,7 +37,7 @@ mixed_precision = "fp16"
 peft = True
 quantization = "int4"
 lora_r = 64
-lora_alpha = 64
 lora_dropout = 0.1
 model_max_length = 2048
 ---

 peft = True
 quantization = "int4"
 lora_r = 64
+lora_alpha = 32
 lora_dropout = 0.1
 model_max_length = 2048
 ---