Valid setting for MNIST 10-20-400-400 momentum alone experiment. Scale-out hidden layers with 4 machines. Use multiple operators per machines is SLOW! Starting image size = 16.
MNIST revisit 6-16-60-400 3conv 1hid momentum +/- adaptive experiments. Also tune pip reg.