Patent ID: 11861264
Assignee: MAXELL, LTD.
Field: Computer technology (Electrical engineering)
Classification: CPC G  H | IPC G

Claim 10:
11. An information processing method comprising:
capturing images of an operator with a camera of a portable terminal device;
capturing voice instructions of the operator with a microphone of the portable terminal device;
transmitting and receiving data between the portable terminal device and a server connected over a network to the portable terminal device;
wherein a first controller of the portable terminal device is programmed to execute a plurality of operations, including:
when the images are obtained from the camera and a single voice instruction is obtained from the microphone, performing a face recognition based on the images and thereafter transmitting the single voice instruction obtained from the microphone to the server;
wherein a second controller of the server is programmed to execute a plurality of operations, including:
receiving the data of the obtained voice transmitted to the server from the portable terminal device,
wherein the second controller of the server is further programmed to:
identify one or more of the operations to be executed based on the received single voice instruction data, and
transmit an identification of one or more results of the plurality of operations to the portable terminal device,
wherein the portable terminal device receives information from the server including the one or more results identified by the server,
wherein, when the portable terminal device receives only one result for operation identified in response to the transmitted data by the server as operation based on the single voice instruction, the first controller of the portable terminal device is programmed to execute an operation corresponding to the one result,
wherein, when the portable terminal device receives a plurality of results for operation identified in response to the transmitted data by the server as operation based on the single voice instruction, the first controller of the portable terminal device is further programmed to:
display a plurality of operation options to be operable by the portable terminal device corresponding to the plurality of results for operation,
capture additional voice instruction for selecting one operation option from the plurality of the operation options corresponding to the single voice instruction to be operable by the portable terminal device during displaying the plurality of operation options based on the single voice instruction,
determine one operation option from the plurality of the operation options to be operable by the portable terminal device based on the captured voice instruction, and
execute an operation corresponding to the determined one operation option.