How many effective workers does my code use?
If I select X workers in my dataloader, and I train my model using ddp with Y GPUs, is the effective amount of workers running in the machine X*Y or X?
Yes! The script will launch Y times in a separate process. Each process will then create their own dataloader with as many workers as given. So X*Y workers in total accessing your filesystem.