- Dropout perceptron added.
- Activation functions made modular.
- Parameters now have properties attached to them.
- Momentum added to SGD.
- Early stopping on validation set added to SGD.