Load/save error function and regularization.
Log architecture while loading.
Use save/load for MNIST.