Modified learning, dividng learning_rate by sqrt(bunch_size*references)
chaging branch
Added experimental builds
Splitted actions doBackward method in two new methods: doBackprop and doUpdate. Implementation of L2 squared length penalty to improve generalization abilities of SDAEs.
added squared length L2 penalty, debugging results
changing name of squared length upper bound
Dropout + squared length upper bound (debugging)
debugging dropout and squared length upper bound
debugging
Modified bias initialization
Added dropout as an option of actions
Merge branch 'sqrt_bunchsize' of https://github.com/pakozm/april-ann into sqrt_bunchsize
solved bugs on dropout computation
solved bugs on dropout computation
activation function softsign
Merged branches
branches merged
merge with master
commit for test dropout in MNIST
Modified tests for new sqrt bunchsize learning version