Patent ID: 11935296
Assignee: KOREA ADVANCED INSTITUTE OF SCIENCE AND TECHNOLOGY
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 6:
7. A method of online action detection, the method comprising the steps of:
(a) extracting a chunk-level feature of a video chunk sequence of a streaming video;
(b) performing filtering on the chunk-level features of the input video segment; and
(c) classifying an action class and outputting an action class probability using the chunk-level features filtered in the step (b), wherein
the step (b) includes performing the filtering using relevance between the chunk-level feature and an action instance,
the step (b) includes receiving the chunk-level feature sequence and inferring a relation of an action instance represented by a current chunk and other chunks to generate a filtered chunk-level feature sequence to be used for action classification, and
the step (b) includes predicting an action relevance of each chunk with the current point in time so as to generate filtered features in which a feature of a chunk related to the current point in time is emphasized and a feature of a chunk unrelated to the current point in time is filtered out.