Modified learning, dividng learning_rate by sqrt(bunch_size*references)
chaging branch
Added experimental builds
Splitted actions doBackward method in two new methods: doBackprop and doUpdate. Implementation of L2 squared length penalty to improve generalization abilities of SDAEs.
added squared length L2 penalty, debugging results
changing name of squared length upper bound
Dropout + squared length upper bound (debugging)
debugging dropout and squared length upper bound
debugging
Modified bias initialization
Added dropout as an option of actions
Merge branch 'sqrt_bunchsize' of https://github.com/pakozm/april-ann into sqrt_bunchsize
solved bugs on dropout computation
solved bugs on dropout computation
activation function softsign
Merged branches
branches merged
Added function to convert MLP in ALL-ALL-MLP, and solved not initilizaed bug in mlp.cc
Modified compute generalization script
Added autocorrelation script for time series