Patent ID: 7984010

Claim:
An action agenda determining apparatus for determining an action agenda to be taken, from surrounding situation at a site where human presence is possible, comprising: model storage unit for storing an action agenda determining model that has learned in advance relation between time-sequence of prescribed feature information related to human motion extracted from images of surroundings and action agenda to be taken; and model reference unit for forming said time-sequence of prescribed feature information from motion images of surroundings and referring to the action agenda determining model stored in said model storage unit, for determining the action agenda to be taken, wherein said model reference unit includes, skin color detecting unit for detecting skin-colored portion from each frame of said motion images, tracking unit for identifying a combination of face and hands of one same person from the skin-colored portions detected by said skin color detecting unit and tracking the face and hands for each combination, of said motion images, and device for determining action agenda by forming, frame by frame, said prescribed feature information from motions of face and hands of each person tracked by said tracking unit, and referring to said action agenda determination model stored in said model storage unit, using said prescribed feature information for a plurality of frames.