If a layer doesn't implement get_weight_decay and the requested weight decay for it is 0., then
the NotImplementedError should be catched and ignored.
See WeightDecay.