A stereoscopic vision system.
Stereo vision is used to locate objects and places that are indicated by the spot of laser light.
An intelligent planning system interprets the multimodal commands and directs the robot's actions. This intelligent and adaptive planner reduces cognitive load on the user by taking over most high-level and all low level planning tasks. The planner is also able to learn new tasks and adapt to changing situations and events. It either replans on its own or interacts with the user when it is unable to construct a plan on its own. With the user in the control loop, interacting actively with the planner through the multimodal interface, the robot system is simplified and released from performing the complex object recognition tasks that are often required by autonomous systems.