Patent ID: 11963759
Assignee: MITSUBISHI ELECTRIC CORPORATION
Field: Medical technology (Instruments)
Classification: CPC A  G | IPC A  G

Claim 0:
1. A state determination device comprising:
a processor to execute a program; and
a memory to store the program which, when executed by the processor, performs processes of,
extracting a face region representing a region corresponding to a face from each of a plurality of image frames successively obtained by electronically capturing images of a user's face, extracting face feature points representing parts of the face from the face region, calculating a face feature value extraction region as a region where a change occurs in the face region when the user is in an unawakened state based on the face feature points, extracting a face feature value as a feature value from the face feature value extraction region,
determining whether the user is in the unawakened state or not based on the face feature value in each of the plurality of frames and previously generated determination information, and outputting a determination result,
wherein
the face feature value extraction region is a mouth region in the face region,
the determination information includes information for determining an unawakenedness level according to a number of times the user licked the user's lips, and
when a process of the determining whether the user is in the unawakened state or not is executed, the program which, when executed by the processor, performs processes of,
calculating the number of times the user licked the lips based on the face feature value extracted from the mouth region in each of the plurality of frames, determining the unawakenedness level based on the number of times the user licked the lips and the determination information, and determining that the user is in the unawakened state when the determined unawakenedness level is higher than or equal to a predetermined threshold level,
wherein the user is an automobile driver or a factory worker and the process of determining whether the user is in the unawakened state or not determines whether or not the automobile driver or factory worker is in the unawakened state to improve automotive or factory safety, respectively, and
wherein the process of determining the unawakenedness level accesses a state determination model table stored in memory and compares the calculated number of times the user licked the lips with information stored in the state determination model.