No barrier, Sequential training, Scale up to 15 machines with 10000 neurons.