apex gradient clipping
#🐛 Bug
It seems when apex + gradient clipping is not handled explicitly.
I see note here https://nvidia.github.io/apex/advanced.html#gradient-clipping.
where amp.master_params needs to be used.
Is what's in this repo correct or not?