Don't Decay the Learning Rate, Increase the Batch Size
Sample size selection in optimization methods for machine learning