More Details about Distributed Data Parallel Random Seed
❓ Questions and Help
https://pytorch-lightning.readthedocs.io/en/stable/multi_gpu.html#distributed-data-parallel
The document says: during Distributed-Data-Parallel
"Make sure to set the random seed so that each model inits with the same weights"
Is there any more detailed information? Where should I add the code to fix random seed.
I searched for the PyTorch document and found nothing.
Any help would be very appreciated.