Adagrad variants work. vSGD not so much, not sure exactly what the problem is.