Patent ID: 9129158
Filing Date: 2015-09-08
Classification: G06K,G06T

Abstract:
1. A system for embedding visual intelligence, the system comprising: one or more processors and a memory having instructions such that when the instructions are executed, the one or more processors perform operations of: receiving an input video comprising input video pixels representing at least one action and at least one object having a location; processing at least one input query to elicit information regarding the input video; generating microactions from the input video using a set of motion sensitive filters derived from a series of filtering and max operations in repeating layers; learning of a relationship between the input video pixels and the microactions in both unsupervised and supervised manners; learning, from the microactions, at least one concept, comprising spatio-temporal patterns, and a set of causal relationships between the spatio-temporal patterns in an automatic, unsupervised manner using form and structure learning techniques; learning to acquire new knowledge from the spatio-temporal patterns using mental imagery models in an unsupervised manner; and presenting a visual output to a user based on the learned set of spatio-temporal patterns and the new knowledge to aid the user in visually comprehending the at least one action in the input video.