Before revision: In theory, the choice of ReLU  (0) in [0, 1] for a neural network has a negligible influence both on backpropagation and training.
After revision: In theory, the choice of ReLU ' (0) in [0, 1] for a neural network has a negligible influence both on backpropagation and training.