Isn't it possible to find hyperparams values to reach better accuracy with `tanh` activations? It should be possible to go below 2% error rate with a vanilla MLP on mnist.