Tested new image-reading process. Works faster.
Setting with image size starting with 79x79 pixels. Hit network capactity between feeder/1st conv layer. Overall training slows down over. Throughput from feeder is low although downstream computations are not high.
Compressed DoubleMatrix in sources. There are 2 training and 1 testing sources. First conv layer has more jobs in decompressing. Tested and works. Good throughput at outgoing traffic of data feeder
Drop-out in FC-layer, input layer, weight decay, decouple lr in conv and fc layers. This version works with imagenet100. Conv3 Hid2.