Abstract-In this paper, we propose a deep learning based approach for facial action unit detection by enhancing and cropping the regions of interest. The approach is implemented by adding two novel nets (layers): the enhancing layers and the cropping layers, to a pretrained CNN model. For the enhancing layers (the E-Net), we designed an attention map based on facial landmark features and applied it to a pretrained neural network to conduct enhanced learning. For the cropping layers (the CNet) , we crop facial regions around the detected landmarks and design convolutional layers to learn deeper features for each facial region. We then fuse the E-Net and the C-Net to obtain our Enhancing and Cropping (EAC) Net, which can learn both feature enhancing and region cropping functions. Our approach shows significant improvement in performance compared to the state-of-the-art methods applied to BP4D and DISFA AU datasets.
Recently, Li et al. REF proposed the EAC-Net for facial AU detection by enhancing and cropping the ROIs with roughly extracted facial landmark information.
EAC-Net: A Region-Based Deep Enhancing and Cropping Approach for Facial Action Unit Detection
2017 12th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2017)
2017 12th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2017)
Computer Science