Automatic facial image analysis has been a long standing research problem in computer vision. A key component in facial image analysis, largely conditioning the success of subsequent algorithms (e.g. facial expression recognition), is to define a vocabulary of possible dynamic facial events. To date, that vocabulary has come from the anatomicallybased Facial Action Coding System (FACS) or more subjective approaches (i.e. emotion-specified expressions). The aim of this paper is to discover facial events directly from video of naturally occurring facial behavior, without recourse to FACS or other labeling schemes. To discover facial events, we propose a temporal clustering algorithm, Aligned Cluster Analysis (ACA), and a multi-subject correspondence algorithm for matching expressions. We use a variety of video sources: posed facial behavior (CohnKanade database), unscripted facial behavior (RU-FACS database) and some video in infants. Accuracy of (unsupervised) ACA approached that of a supervised version, achieved moderate intersystem agreement with FACS, and proved informative as a visualization/summarization tool.
al proposed an unsupervised temporal segmentation and clustering algorithm, Aligned Cluster Analysis (ACA) for dynamic facial event analysis, and a multi-subject correspondence algorithm for matching expressions REF .
Unsupervised discovery of facial events
2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition
2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition
Computer Science