LukeOLuck
/

llama2-7-dolly-answer

Model card Files Files and versions Metrics Training metrics Community

LukeOLuck commited on Feb 22

Commit

5af9d05

•

1 Parent(s): ed06260

Model save

Files changed (1) hide show

README.md +2 -4

README.md CHANGED Viewed

@@ -40,12 +40,10 @@ The following hyperparameters were used during training:
 - train_batch_size: 32
 - eval_batch_size: 8
 - seed: 42
-- gradient_accumulation_steps: 2
-- total_train_batch_size: 64
 - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
-- lr_scheduler_type: linear
 - lr_scheduler_warmup_ratio: 0.03
-- num_epochs: 3
 ### Training results

 - train_batch_size: 32
 - eval_batch_size: 8
 - seed: 42
 - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
+- lr_scheduler_type: constant
 - lr_scheduler_warmup_ratio: 0.03
+- num_epochs: 2
 ### Training results