We propose a two-stage detector that can not only detect and localize hands, but also provide fine-detailed information in the bounding box of hand in an efficient fashion. In the first stage, hand bounding box proposals are generated from a pixel-level hand probability map. Next, each hand proposal is evaluated by a Multi-task Convolutional Neural Network to filter out false positives and obtain fine shape and landmark information. Through experiments, we demonstrate that our method is efficient and robust to detect hands with their shape and landmark information, and our system can also be flexibly combined with other detection methods to handle a new scene. Further experiment shows that our Multi-task CNN can also be extended to hand gesture classification with a large performance increase.
Zhu et al. REF propose a two-stage detector which firstly generates bounding box proposals and secondly evaluates the proposals by a convolutional neural network.
A two-stage detector for hand detection in ego-centric videos
2016 IEEE Winter Conference on Applications of Computer Vision (WACV)
2016 IEEE Winter Conference on Applications of Computer Vision (WACV)
Computer Science