Assertion: neural network's parameter | /r/CapableOf | follow standard normal distribution
Facets:
value: randomly
type: MANNER
Source sentences:
text: Initializing the parameters randomly following a standard normal distribution is correct, but it can lead to possible problems of vanishing gradients (when the values of a gradient are too small and the model stops learning or takes too long due to that) or exploding gradients (when the algorithm assigns an exaggeratedly high importance to the weights).