Should we use momentum method in full batch gradient descent ?
Why are optimization techniques like natural gradient and second order methods -LRB- L-BFGS for eg . -RRB- not much used in deep learning ?