Before revision:  To address these, we incorporate several novel approaches in AdaHessian , including: (i) a new variance reduction estimate of the Hessian diagonal with low computational overhead;
After revision:  To address these, we incorporate several novel approaches in AdaHessian , including: (i) a fast Hutchinson based method to approximate the curvature matrix with low computational overhead;