L-BFGS is sometimes much faster than gradient descent. However, with lots of tuning, it is often possible to get better results with gradient descent.