Report memory usage, iteration speed, store gradients and aux variables