A question about metrics on ddp
Thanks for the nice work! 🥳🥳🥳
Backgroud
The new metrics package is released with build-in ddp support.
DistributedSampler is used by dataloaders to work with ddp.
It adds extra samples to make the samples evenly divisible.
This means during evaluation and testing, the added extra samples affect the eval result.
Question
Does the metrics package remove the extra redundant samples to make sure the eval result is not affected?
I have looked into the code and find the answer is NO.
Did I miss something or it's just not been resolved for now?