NewstaR
/

StableGalen-6b

Text Generation

text-generation-inference

Model card Files Files and versions Community

baebee commited on Sep 18, 2023

Commit

fb8c16b

•

1 Parent(s): 5a91008

Update README.md

Files changed (1) hide show

README.md +3 -2

README.md CHANGED Viewed

@@ -30,5 +30,6 @@ Prompt templates
 - target_modules = ["q_proj", "v_proj", "gate_proj", "down_proj", "up_proj", "k_proj", "o_proj"]
 - Learning Rate: 4e-4
 - LR Scheduler: constant
-- 250
-## Total Time: 1 Hour

 - target_modules = ["q_proj", "v_proj", "gate_proj", "down_proj", "up_proj", "k_proj", "o_proj"]
 - Learning Rate: 4e-4
 - LR Scheduler: constant
+- 250 Steps
+## T3: 1 Hour