Implement the DeepFace net architecture achieving near human level face recognition performance

Facebook claimed near human level face verification performance on the standard benchmark dataset LFW[1]. It took only 3 days to train on more 4.4 million face images for about 15 epochs. In comparison, it took Caffe 9 to 10 days to train on the 1.2 million ILSVRC images for about 90 epochs. The former was about two times faster. It is not clear whether the so call GPU-based engine used to train the net consists of a single or multiple GPU devices. 

It used only two computationally expensive convolutional layers and three relatively cheaper locally connected layers. Unlike the convolutional layer, the locally connected layer uses kernels without weight sharing. The details are not very clear in [1]. Its references [2] and [3] may give more clues.

The net parameters still have rough edges and the locally connected layer has yet to be implemented.

[1] Yaniv Taigman (Facebook), Ming Yang (Facebook), Marc'Aurelio Ranzato (Facebook), Lior Wolf (Tel Aviv University). DeepFace: Closing the Gap to Human-Level Performance in Face Verification. CVPR 2014, Columbus, Ohio.
[2] K. Gregor and Y. LeCun. Emergence of complex-like cells in a temporal product network with local receptive ﬁelds. arXiv:1006.0448, 2010.
[3] G. B. Huang, H. Lee, and E. Learned-Miller. Learning hierachical representations for face verifiation with convolutional deep bebief networks. In CVPR, 2012.