Venue: NeurIPS 2022 Workshop HITY

Reviews:

final_score: rating: 1: accept
review_content: This paper evaluates the use of a hessian free second order optimizer for late stage training where first order methods are not making much progress.  The idea makes sense and seems promising on CIFAR-100 experiments.  Results don't seem great outside of CIFAR-100 but the idea still seems worth further investigation.
review_title: Using hessian free optimization for late stage training

final_score: rating: 1: accept
review_content: The authors empirically compare first-order methods with second-order Hessian-free methods in different stages of training in deep learning. The results look very promising and the content is clearly presented.
review_title: Second-order Hessian-free methods in late-phase training

Decision: Accept