teddy-f-47
/

phi-pl-400M-v_0_1

Text Generation

Generated from Trainer

Inference Endpoints

Model card Files Files and versions Metrics Training metrics Community

teddy-f-47 commited on Jan 8

Commit

1b49982

•

1 Parent(s): 12482b0

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -41,7 +41,7 @@ The 20231201 Polish Wikipedia dump.
 The following hyperparameters were used during training:
 - learning_rate: 0.0002
-- distributed_type: multi-GPU
 - num_devices: 4
 - train_batch_size: 2
 - gradient_accumulation_steps: 8

 The following hyperparameters were used during training:
 - learning_rate: 0.0002
+- distributed_type: multi-GPU (DDP)
 - num_devices: 4
 - train_batch_size: 2
 - gradient_accumulation_steps: 8