I would add: the random initialization of the weight can have an impact on the final predictive accuracy of a trained model. However this tend to not be a real problem in practice, especially for single hidden layer models as implemented here.