Trying lower max_norm regularization, lower learning rate, bigger batch sizes