Patent Document ID: 8351647
Application ID: 12002398
Patent Status: 1

Claim One:
1. A method for detecting and aggregating demographics and behavior of people, comprising the following steps of: a) detecting the people from a plurality of input images in the vicinity of a fixture with at least a visual sensing device using a control and processing system, wherein the visual sensing device is connected to a means for video interface, b) detecting faces in the plurality of input images, c) detecting locations of facial features on the detected faces and estimating facial geometry including position, size, and orientation of the detected faces, d) aligning the detected faces using the facial geometry estimation, e) building appearance models of the people across image frames containing the detected faces, by averaging pixel values of the detected faces, aligned using estimates for the position, size, and orientation of the detected faces, wherein an estimation of the position, size, and orientation is carried out by employing a parallel array of multiple learning machine regressors, f) tracking the detected faces by keeping identities assigned to the detected faces, g) obtaining demographics information and behavior features of the people automatically, h) computing timestamps and location markers for the obtained demographics information and behavior features, and i) combining the obtained demographics information and behavior features with the timestamps and the location markers into a feature vector, wherein the behavior is detected based on an analysis of measurements for the behavior features, wherein the behavior features comprise timestamps, start time and end time of tracks for appearance and disappearance of the detected faces, duration of watching fixtures, counts of the detected faces, counts of attentive faces, viewership, location markers, and facial pose estimates, and wherein the demographics information comprises estimates of gender, age, and ethnicity of the people.