Patent ID: 7668797
Filing Date: 2010-02-23
Classification: G06K,G06N

Abstract:
1. An active semiotic system for image and video understanding by autonomous robots and unmanned vehicles to provide better situation awareness and intelligent tactical behavior in real world situations, the active semiotic system comprising: a plurality of sensor and active vision controllers that obtain visual information corresponding to a visual scene in real world situations; a visual information processor that processes the visual information into semiotic form; a semiotic engine comprising: a linker that generates active diagrammatic models of the visual scene in accordance with the visual information processed into semiotic form; a plurality of derivation engines that transform the active diagrammatic models into higher-level active diagrammatic models using graphs and diagrammatic information and that identify object classes within the visual scene; a plurality of knowledge acquisition engines that convert information from other formats into internal representations corresponding to the active diagrammatic models; a memory that stores the active diagrammatic models as a plurality of implicit symbols and their alphabets and a plurality of diagrams and reference links; a loader that loads the plurality of implicit symbols and their alphabets and the plurality of diagrams and reference links into the memory; a plurality of recognition engines that recognize the implicit symbols stored in the memory; and an activation manager that controls the plurality of implicit symbols and their alphabets and the plurality of diagrams and reference links stored in the memory; and a behavior planning services module that predicts and plans a course of action in accordance with the active diagrammatic models and that communicates the course of action to control systems of autonomous robots or unmanned systems for situation awareness and intelligent tactical behavior in real world situations.