Patent ID: 8381238

Claim:
An information processing apparatus comprising: an image analyzing unit performing a process of analyzing an image shot by a camera; a voice analyzing unit performing a process of analyzing voice input from a microphone; and a data processing unit receiving inputs of an analysis result of the image analyzing unit and an analysis result of the voice analyzing unit and controlling information to be output to a user; wherein: the data processing unit determines an output mode of the information to be provided to the user based on user information obtained from the image analysis result and the voice analysis result, and system state information, and outputs the information to the user in the determined output mode; the data processing unit determines based on the analysis result of the image analyzing unit whether the user is paying attention to the information processing apparatus and, when determining that the user is not paying attention to the information processing apparatus, performs information output with voice or sound effect; the data processing unit controls output by changing a level of information to be output to the user based on information about errors previously caused by the user; and the data processing unit determines a level of skill of the user for using the information processing apparatus based on operation history information indicating previous operations performed by the user on the information processing apparatus and, performs control of outputting a brief description when determining that the user is not a beginner and outputting a detailed description or a description at a normal level when determining that the user is a beginner.