Does self.log do ddp sync automatically?
Does self.log do ddp sync automatically? mean or sum?
Or I have to do ddp sync manually in training_step_end then log it, instead of directly log it in training_step?
--------update---------
I see ddp sync options in code, but it doesn't show in docs. I still have a question, what's the difference of reduce_fx  and sync_dist_op ?