kejian
/

curious-filtering

generated_from_trainer

Inference Endpoints

text-generation-inference

Model card Files Files and versions Community

kejian commited on Dec 14, 2022

Commit

fff7b69

•

1 Parent(s): 939e11d

update model card README.md

Files changed (1) hide show

README.md +4 -4

README.md CHANGED Viewed

@@ -36,10 +36,10 @@ More information needed
 The following hyperparameters were used during training:
 - learning_rate: 0.0005
-- train_batch_size: 32
-- eval_batch_size: 16
 - seed: 42
-- gradient_accumulation_steps: 4
 - total_train_batch_size: 128
 - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
 - lr_scheduler_type: linear
@@ -123,4 +123,4 @@ The following hyperparameters were used during training:
               'weight_decay': 0.1}}
 # Wandb URL:
-https://wandb.ai/kejian/uncategorized/runs/b4ejn68y

 The following hyperparameters were used during training:
 - learning_rate: 0.0005
+- train_batch_size: 64
+- eval_batch_size: 32
 - seed: 42
+- gradient_accumulation_steps: 2
 - total_train_batch_size: 128
 - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
 - lr_scheduler_type: linear
               'weight_decay': 0.1}}
 # Wandb URL:
+https://wandb.ai/kejian/uncategorized/runs/3se8ueja