Source: https://patents.google.com/patent/JP2005348036A/en
Timestamp: 2020-04-05 17:41:22
Document Index: 482053327

Matched Legal Cases: ['art 171', 'art, 21', 'art, 22', 'art, 41', 'art, 92', 'art, 93']

JP2005348036A - Information processing system, information input device, information processing method and program - Google Patents
Information processing system, information input device, information processing method and program Download PDF
JP2005348036A
JP2005348036A JP2004164588A JP2004164588A JP2005348036A JP 2005348036 A JP2005348036 A JP 2005348036A JP 2004164588 A JP2004164588 A JP 2004164588A JP 2004164588 A JP2004164588 A JP 2004164588A JP 2005348036 A JP2005348036 A JP 2005348036A
JP2004164588A
Yoshifumi Tochi
佳史 土地
2004-06-02 Application filed by Sony Corp, ソニー株式会社 filed Critical Sony Corp
2004-06-02 Priority to JP2004164588A priority Critical patent/JP2005348036A/en
2005-12-15 Publication of JP2005348036A publication Critical patent/JP2005348036A/en
<P>PROBLEM TO BE SOLVED: To select a plurality of functions only with a track pad. <P>SOLUTION: An operation for tracing a track pad 11 for about one round as in A of a figure is associated with power on if it is clockwise rotation, associated with power off if it is counterclockwise rotation, an operation for drawing a V shape on the track pad 11 with a single stroke of a brush as in B of the figure is associated with a function for changing channels and an operation for drawing a graphic turning the V shape upside down on the track pad 11 with a single stroke of the brush as in C of the figure is associated with a function for changing volume of outputted sound. An operation for drawing > on the track pad 11 with a single stroke of the brush as in D of the figure is associated with a function for changing input sources of data to be acquired, an operation for drawing < on the track pad 11 with a single stroke of the brush as in E of the figure is associated with a function for calling setting menus and an operation for tracing the track pad 11 from the left direction to the right direction as in F of the figure is associated with a function for operating a free cursor. This invention is applicable to a remote commander. <P>COPYRIGHT: (C)2006,JPO&NCIPI
The present invention relates to an information processing system, an information input device, an information processing method, and a program, and in particular, when a user performs an operation input to a predetermined device, an operation for selecting a function and a value for the function The present invention relates to an information processing system, an information input device, an information processing method, and a program capable of realizing an input operation and an operation of moving a free cursor by a consistent operation using one input device. .
Conventionally, in a remote commander (so-called remote controller) for operating a television receiver, an air conditioner (air conditioner), etc., each function of the device to be operated with respect to each button provided on the remote commander Was to be assigned. A user can operate a television receiver or an air conditioner by operating a button corresponding to a function to be used.
A remote commander equipped with a cross button is also widely used to operate a menu for changing the setting of the television receiver. Furthermore, in recent years, for example, a remote commander including a shuttle ball is used so that a user can freely operate a cursor displayed on a display screen of a television receiver (for example, Patent Document 1). ).
Japanese Patent No. 3239492
Further, although not a remote commander, an iPod (trademark) sold by Apple Computer Corporation has a circular or donut-shaped track pad called a touch wheel (for example, Non-Patent Document 1). The user can move the cursor in the menu display screen or change the volume level by tracing the trackpad with a finger.
"Apple-ipod", [online], Apple Computer, Inc., [Search May 26, 2004], Internet, <URL: http://www.apple.co.jp/ ipod />
However, when performing operation input using the above-described conventional remote commander, or when performing operation input using the trackpad as an input device, an operation for selecting a function, an input value for the function (for example, a volume level) Etc.) and the operation to move the free cursor must be performed for each of the multiple input devices. Furthermore, these operation input methods are not consistent and are independent operations. It was done as. For example, in a remote commander with a cross button, first press the volume setting button, then operate the cross button to adjust the volume level or press the menu button to display the menu screen, It is necessary to move the free cursor by operating the cross button. Similarly, in a remote commander equipped with a shuttle ball, it is necessary to operate the shuttle ball to move the cursor, and it is necessary to operate each button to change the volume and channel. In addition, in the iPod (trademark), it is necessary to operate the touch wheel after calling a menu or calling a volume changing function by a button other than the touch wheel.
The present invention has been made in view of such a situation, and an operation for selecting a function, an operation for inputting a value for the function, and an operation for moving a free cursor are performed using one input device. It can be realized by consistent operation.
The information processing system according to the present invention is an information processing system including an information input device and an information processing device, and the information input device includes an operation input unit that receives a user's operation input, and a user input by the operation input unit. An input mode control means for controlling the input mode based on the operation input, and a first transmission means for transmitting information relating to the input mode controlled by the input mode control means to the information processing apparatus. Has a graphic drawing area having a predetermined surface area, and the input mode control means controls the input mode based on the shape of the graphic drawn by the user in the graphic drawing area of the operation input means. A first receiving means for receiving information transmitted by the first transmitting means of the information input device, and an information processing device based on the information received by the first receiving means. The operation control means for controlling the operation that can be executed, and the display means for displaying the predetermined information according to the control by the operation control means, the display means corresponding to the input mode of the information input device by the user Information for assisting operation input to the operation input means is displayed.
The information processing apparatus may further include a second transmission unit that transmits information related to the input mode to the information input apparatus. The information input apparatus transmits the information by the second transmission unit of the information processing apparatus. The second receiving means for receiving information on the input mode can be further provided. The operation control means of the information processing apparatus has the input mode based on the operation being executed by the information processing apparatus. The information for designating the information can be transmitted to the information input device by the second transmission means, and the input mode control means of the information input device has the input mode received by the second reception means. The input mode can be further controlled based on the information for designating.
The operation control means of the information processing apparatus is in a state in which the operation being executed is instructed to move the cursor using the information input device by the user referring to the predetermined information displayed by the display means. In this case, information for setting the input mode to an input mode that receives an operation input corresponding to the movement of the cursor can be transmitted to the information input device by the second transmitting means.
Information for assisting the operation input by the user displayed on the display means of the information input device can be displayed in a shape corresponding to the shape of the operation input means of the information input device.
The shape of the operation input means of the information input device can be circular.
According to a first information processing method of the present invention, an information input device having a predetermined graphic rendering area and provided with an operation input unit for receiving a user's operation input, and a display unit capable of displaying predetermined information are provided. An information processing method for an information processing system configured with an information processing apparatus that is configured to obtain a first operation input of a user that is input by an operation input unit in the information input device And a shape analysis step for analyzing the shape of the graphic drawn in the graphic drawing area based on the first operation input of the user acquired by the processing of the first operation input acquisition step in the information input device; In the information input device, an extraction step for extracting the command content of the user based on the shape of the figure analyzed by the processing of the shape analysis step, and in the information input device, the extraction step A first transmission step for transmitting information corresponding to a user instruction content extracted by the process to the information processing apparatus; and an input mode based on the user instruction content extracted by the extraction step process in the information input device. An input mode control step for controlling the information, a reception step for receiving information corresponding to the user's instruction content transmitted by the processing of the first transmission step in the information processing device, and a processing of the reception step in the information processing device The display control step for controlling the display of predetermined information on the display unit based on the content of the user command received by the control unit, and the input mode controlled by the processing of the input mode control step in the information input device The second operation for acquiring the second operation input of the user referring to the display unit, which is input by the operation input unit. An input obtaining step, characterized in that it comprises a second transmission step of transmitting information corresponding to the second operation input of the user obtained by the process of the second operation input obtaining step to the information processing apparatus.
The first program of the present invention receives an operation input from a user to an information processing apparatus provided with a display unit capable of displaying predetermined information, using an operation input unit having a predetermined graphic rendering area, A first operation input acquisition step for causing a computer to execute processing for transmitting information corresponding to a user's operation input to a device, and acquiring a user's first operation input input by an operation input unit And a shape analysis step for analyzing the shape of the graphic drawn in the graphic drawing area based on the first operation input of the user acquired by the processing of the first operation input acquisition step, and the processing of the shape analysis step An extraction step for extracting user command contents based on the shape of the analyzed figure, and information corresponding to the user command contents extracted by the processing of the extraction step A first transmission control step for controlling transmission to the information processing device; an input mode control step for controlling an input mode based on a user instruction content extracted by the extraction step; and a first transmission control step. Input by the operation input unit by the user who referred to the information for assisting the operation input displayed on the display unit of the information processing apparatus that has received the information corresponding to the instruction content of the user whose transmission is controlled by the process of The second operation input acquisition step for acquiring the second operation input based on the input mode controlled by the process of the input mode control step, and the user's first operation acquired by the process of the second operation input acquisition step And a second transmission control step for controlling transmission of information corresponding to the operation input 2 to the information processing apparatus. To be executed by the data.
In the information processing system, the first information processing method, and the first program of the present invention, a user's operation input is acquired by the information input device, and the graphic drawing area is based on the acquired user's operation input. The shape of the graphic depicted in FIG. 6 is analyzed, and based on the shape of the graphic, the user's command content is extracted, information corresponding to the user's command content is transmitted to the information processing device, and based on the user's command content, Information for assisting the operation input is displayed on the display unit of the information processing apparatus whose input mode is controlled and receives information corresponding to the user's command content, and the operation input by the user who refers to the information is displayed on the information input apparatus Is acquired, and information corresponding to the acquired user operation input is transmitted to the information processing apparatus.
An information input device according to the present invention includes an operation input unit that receives a user operation input, an input mode control unit that controls an input mode based on the user operation input input by the operation input unit, and an input mode control unit. In accordance with the input mode to be controlled, a display means for displaying the first information, and a transmission means for transmitting the second information related to the operation input for the user to control the predetermined device to the predetermined device, The operation input means has a graphic drawing area having a predetermined surface area, and the input mode control means controls and displays the input mode based on the shape of the graphic drawn in the graphic drawing area of the operation input means by the user. The first information displayed by the means is information for assisting the user to perform an operation input to the operation input means of the information input device corresponding to the input mode. Second information to be transmitted, characterized in that the information relating to the performed operating input by the user with reference to the first information displayed by the display means.
Information for assisting the operation input by the user displayed on the display means may be displayed in a shape corresponding to the shape of the operation input means.
The shape of the operation input means can be circular.
A second information processing method according to the present invention is an information processing method for an information input device, which includes an operation input unit that has a predetermined graphic rendering area and receives a user operation input, and a display unit that can display predetermined information. The first operation input acquisition step of acquiring the first operation input of the user input by the operation input unit, and the first operation of the user acquired by the processing of the first operation input acquisition step A shape analysis step for analyzing the shape of the graphic drawn in the graphic drawing area based on the input; and an extraction step for extracting the user's command content based on the shape of the graphic analyzed by the processing of the shape analysis step; The display control step for controlling the display of predetermined information on the display unit based on the user command content extracted by the extraction step process, and the user command extracted by the extraction step process A first transmission step for transmitting information corresponding to the content to another device, an input mode control step for controlling the input mode based on the user instruction content extracted by the processing of the extraction step, and an input mode control step The second operation input acquisition step for acquiring the second operation input of the user input by the operation input unit and the processing of the second operation input acquisition step based on the input mode controlled by the processing of And a second transmission step of transmitting information corresponding to the user's second operation input to another device.
A second program of the present invention is a user for another information processing apparatus using an operation input unit that has a predetermined graphic rendering area and receives a user's operation input and a display unit that can display predetermined information. Is a program for causing a computer to execute processing for transmitting information corresponding to a user's operation input to the information processing apparatus, and obtaining the first operation input of the user input by the operation input unit Shape analysis for analyzing the shape of the graphic drawn in the graphic drawing area based on the first operation input of the user acquired by the first operation input acquisition step and the processing of the first operation input acquisition step An extraction step for extracting the user's command content based on the shape of the figure analyzed by the step and the shape analysis step; and the user extracted by the extraction step Based on the contents of the instruction, the display control step for controlling the display of the predetermined information on the display unit and the transmission of the information corresponding to the instruction contents of the user extracted by the processing of the extraction step to the information processing device are controlled. The first transmission control step, the input mode control step for controlling the input mode based on the user instruction content extracted by the processing of the extraction step, and the input mode controlled by the processing of the input mode control step. Based on the second operation input acquisition step for acquiring the second operation input of the user input by the operation input unit and the second operation input of the user acquired by the processing of the second operation input acquisition step. A second transmission step for controlling transmission of the corresponding information to the information processing apparatus.
In the information input device, the second information processing method, and the second program of the present invention, a user's operation input is acquired, and a graphic drawn in the graphic drawing area based on the acquired user's operation input The user's command content is extracted based on the shape of the figure, information corresponding to the user's command content is transmitted to the information processing apparatus, and the input mode is controlled based on the user's command content. The information for assisting the operation input is displayed based on the user's instruction content, the operation input by the user referring to this is acquired, and the information corresponding to the acquired user operation input is transmitted to the information processing apparatus. The
In the present invention, a predetermined apparatus can be remotely operated. In particular, the input mode is controlled based on the shape of a graphic drawn on only one operation input device, and a GUI based on the input mode is displayed on the display unit. A predetermined apparatus is controlled based on an operation input to a single operation input device by a user who is displayed and refers to the GUI.
Embodiments of the present invention will be described below. The correspondence relationship between the invention described in this specification and the embodiments of the invention is exemplified as follows. This description is intended to confirm that the embodiments supporting the invention described in this specification are described in this specification. Therefore, even if there is an embodiment that is described in the embodiment of the invention but is not described here as corresponding to the invention, the fact that the embodiment is not It does not mean that it does not correspond to the invention. Conversely, even if an embodiment is described herein as corresponding to an invention, that means that the embodiment does not correspond to an invention other than the invention. Absent.
The information processing system according to claim 1 includes an information input device (for example, the remote commander 1 or the remote commander 121) and an information processing device (for example, the television receiver 2 or the television receiver 122). In the system, the information input device changes the input mode based on the operation input means (for example, the track pad 11 in FIG. 1) that receives the user's operation input and the user's operation input input by the operation input means. Input mode control means for controlling (for example, the state management processing section 93 in FIG. 4 and the state management processing section 131 in FIG. 18) and information on the input mode controlled by the input mode control means is transmitted to the information processing apparatus. 1 transmission means (for example, infrared transmission unit 12 in FIG. 4, ie, infrared transmission unit 96 in FIG. 4 or infrared transmission / reception in FIG. 18) And the operation input means has a graphic drawing area having a predetermined surface area, and the input mode control means is a shape of a graphic drawn by the user in the graphic drawing area of the operation input means (for example, FIG. 6 is used to control the input mode, and the information processing apparatus receives first information transmitted by the first transmission means of the information input apparatus (for example, FIG. 4). Operation control means (for example, FIG. 4) that controls operations that can be performed by the information processing device based on the information received by the first receiving means and the infrared receiving section 101 of FIG. The operation control unit 103 or the operation control unit 142 in FIG. 18 and a display unit (for example, the display unit 22 in FIG. 1) for displaying predetermined information according to control by the operation control unit. Corresponding to the input mode, information for assisting the user to input an operation to the operation input means of the information input device (for example, the display screen described with reference to FIGS. 7 to 11 and FIGS. 13 and 14). Displayed information) is displayed.
The information processing apparatus can further include a second transmission unit (for example, the infrared transmission / reception unit 141 in FIG. 18) that transmits information regarding the input mode to the information input apparatus, and the information input apparatus is a second information processing apparatus. The second receiving means (for example, the infrared transmitting / receiving unit 132 in FIG. 18) that receives the information related to the input mode transmitted by the transmitting means can be further provided. The information for designating the input mode can be transmitted to the information input device by the second transmission means based on the operation being executed by the second input means. The input mode control means of the information input device is the second reception means. The input mode can be further controlled based on the information for designating the input mode received by.
The information processing method according to claim 6 is an information having an operation input unit (for example, the track pad 11 of FIG. 1 or FIG. 21) having a predetermined graphic rendering area and receiving an operation input of a user. An information processing method of an information processing system including an input device and an information processing device provided with a display unit (for example, the display unit 22 in FIG. 1) capable of displaying predetermined information. The first operation input acquisition step (for example, the process of step S3 of FIG. 16 or step S43 of FIG. 19) for acquiring the first operation input of the user input by the operation input unit, and the information input device The shape of the graphic depicted in the graphic depiction area (for example, the shape described with reference to FIG. 6) based on the first operation input of the user acquired by the processing of the first operation input acquisition step Based on the shape of the figure analyzed by the shape analysis step (for example, the process of step S5 of FIG. 16 or the process of step S45 of FIG. 19) and the shape analysis step of the information input device. Information corresponding to the user instruction content extracted by the extraction step process in the information input device and the extraction step (for example, the process of step S6 of FIG. 16 or the process of step S46 of FIG. 19). Is transmitted to the information processing apparatus (for example, step S7 in FIG. 16 or step S47 in FIG. 19), and the user instruction content extracted by the extraction step process in the information input apparatus Based on the input mode control step (for example, step S8 in FIG. 16 or FIG. In step S48), a reception step of receiving information corresponding to the user's instruction content transmitted in the first transmission step in the information processing device, and a reception step processing in the information processing device. Based on the received user instruction content, the display control step for controlling the display of predetermined information on the display unit, and the information input device based on the input mode controlled by the process of the input mode control step A second operation input acquisition step for acquiring the second operation input of the user referring to the display unit, which is input by the operation input unit (for example, step S9 in FIG. 16 or step S49 in FIG. 19). And information corresponding to the second operation input of the user acquired by the process of the second operation input acquisition step is transmitted to the information processing apparatus. And a second transmission step (for example, step S9 in FIG. 16 or step S49 in FIG. 19).
The program according to claim 7 is a display unit (for example, a display unit capable of displaying predetermined information using an operation input unit (for example, the track pad 11 in FIG. 1 or FIG. 21) having a predetermined graphic drawing area. 1 is a program for causing a computer to execute a process of receiving an operation input from a user to an information processing apparatus provided with the display unit 22) in FIG. 1 and causing the information processing apparatus to transmit information corresponding to the user operation input. A first operation input acquisition step (for example, step S3 in FIG. 16 or step S43 in FIG. 19) for acquiring the first operation input of the user input by the operation input unit in the computer; Based on the first operation input of the user acquired by the process of the first operation input acquisition step, the shape of the graphic depicted in the graphic depiction area (for example, using FIG. 6 Based on the shape analysis step (for example, step S5 in FIG. 16 or step S45 in FIG. 19) and the shape of the figure analyzed by the shape analysis step processing, the user command An extraction step for extracting the contents (for example, the process of step S6 in FIG. 16 or the process of step S46 in FIG. 19), and transmission of information corresponding to the user instruction contents extracted by the process of the extraction step to the information processing apparatus The input mode is controlled based on the first transmission control step (for example, step S7 in FIG. 16 or step S47 in FIG. 19) for controlling the user and the instruction content of the user extracted by the extraction step processing. Input mode control step (for example, step S8 in FIG. 16 or step S48 in FIG. 19) and first transmission control Input by the operation input unit by the user who refers to the information for assisting the operation input displayed on the display unit of the information processing apparatus that has received the information corresponding to the command content of the user whose transmission is controlled by the processing of the step. The second operation input acquisition step (for example, step S9 in FIG. 16 or step S49 in FIG. 19) for acquiring the second operation input based on the input mode controlled by the process of the input mode control step. Processing) and a second transmission control step (for example, FIG. 16) for controlling transmission of information corresponding to the second operation input of the user acquired by the processing of the second operation input acquisition step to the information processing apparatus. Step S9 of FIG. 19 or Step S49 of FIG. 19) is executed.
The information input device according to claim 8 (for example, the remote commander 161 in FIGS. 20 and 21) includes an operation input unit (for example, the track pad 11 in FIGS. 20 and 21) that receives a user operation input, and an operation input. The input mode control means (for example, the state management processing unit 191 in FIG. 21) that controls the input mode based on the user's operation input input by the means, and the input mode controlled by the input mode control means. Display means (for example, the liquid crystal display unit 171 in FIG. 20) and transmission means (for example, the second information related to the operation input for the user to control the predetermined apparatus) to the predetermined apparatus (for example, 20, that is, the infrared transmission unit 96 in FIG. 21, and the operation input means has a graphic drawing area having a predetermined surface area, and an input module. The control means controls the input mode based on the shape of the figure drawn by the user in the figure drawing area of the operation input means (for example, the shape described with reference to FIG. 6), and is displayed on the display means. The information of 1 corresponds to the input mode, and is information for assisting the user to input an operation to the operation input means of the information input device (for example, using FIGS. 7 to 11 and FIGS. 13 and 14). The second information transmitted by the transmission means is information related to the operation input executed by the user referring to the first information displayed by the display means. It is characterized by.
An information processing method according to an eleventh aspect includes an operation input unit (for example, the track pad 11 of FIG. 1, FIG. 20, or FIG. 21) that has a predetermined graphic rendering area and receives a user operation input, and a predetermined The information processing method of an information input device provided with the display part (for example, liquid crystal display part 171 of FIG. 20) which can display this information, Comprising: The user's 1st operation input input by the operation input part is acquired. Drawing in the graphic drawing area based on the first operation input acquisition step (for example, the process of step S73 of FIG. 22) and the first operation input of the user acquired by the process of the first operation input acquisition step. The shape analysis step (for example, the process in step S75 in FIG. 22) for analyzing the shape of the processed figure (for example, the shape described with reference to FIG. 6) and the shape of the figure analyzed by the process in the shape analysis step Based on the extraction step (for example, the process of step S76 in FIG. 22) for extracting the user's command content and the user's command content extracted by the process of the extraction step, A display control step for controlling the display (for example, the processing in step S77 in FIG. 22) and a first transmission step for transmitting information corresponding to the user's command content extracted by the extraction step processing to another device (for example, 22), an input mode control step for controlling the input mode based on the user instruction content extracted by the extraction step process (for example, the process of step S79 of FIG. 22), and input. Based on the input mode controlled by the process of the mode control step, the second operation input of the user input by the operation input unit is acquired. Information corresponding to the second operation input of the user acquired by the second operation input acquisition step (for example, the process of step S80 in FIG. 22) and the process of the second operation input acquisition step. And a second transmission step (for example, the process of step S80 in FIG. 22).
The program according to claim 12 has an operation input unit (for example, the track pad 11 in FIG. 1, FIG. 20, or FIG. 21) having a predetermined graphic drawing area and receiving an operation input by a user, and predetermined information The display unit (for example, the liquid crystal display unit 171 in FIG. 20) is used to receive a user operation input to another information processing apparatus, and causes the information processing apparatus to transmit information corresponding to the user operation input. A program for causing a computer to execute processing, and a first operation input acquisition step (for example, processing of step S73 in FIG. 22) that acquires the first operation input of the user input by the operation input unit to the computer. ) And the shape of the figure drawn in the figure drawing area (for example, FIG. 6) based on the first operation input of the user acquired by the process of the first operation input acquisition step. A shape analysis step (for example, the process of step S75 in FIG. 22), and an extraction step of extracting the user's command content based on the shape of the figure analyzed by the shape analysis step process. (For example, the process of step S76 in FIG. 22) and a display control step (for example, FIG. 22) for controlling the display of predetermined information on the display unit based on the user instruction content extracted by the extraction step process. Step S77) and a first transmission control step (for example, step S78 in FIG. 22) for controlling transmission of information corresponding to the user's instruction content extracted by the extraction step processing to the information processing apparatus. Process) and an input mode control step (for example, an input mode control step) for controlling the input mode based on the user instruction content extracted by the extraction step process. The second operation input acquisition for acquiring the second operation input of the user input by the operation input unit based on the input mode controlled by the process of step S79 in FIG. 22 and the input mode control step. Step (for example, the process of step S80 in FIG. 22) and the second control that controls transmission of information corresponding to the user's second operation input acquired by the process of the second operation input acquisition step to the information processing apparatus. 2 transmission steps (for example, the processing in step S80 in FIG. 22).
FIG. 1 is a diagram showing an external configuration of a remote commander 1 and a television receiver 2 to which the present invention is applied. The remote commander 1 is used when the user inputs an operation to the television receiver 2 and corresponds to the circular track pad 11 and the operation input performed on the track pad 11 by the user. An infrared transmission unit 12 that transmits a signal to the television receiver 2 and an error display LED 13 that is turned on when an operation input performed on the trackpad 11 by the user is not correctly detected. ing.
The television receiver 2 processes a television broadcast signal selected and received by a tuner (not shown) to display a video and execute a process of outputting a sound, which is transmitted from the remote commander 1. In addition to the image corresponding to the television signal and the infrared receiver 21 that receives the signal to be transmitted, the menu screen and messages necessary for the user to operate the television receiver 2 are displayed as necessary. A possible display 22 is provided.
FIG. 2 is a hardware block diagram of the remote commander 1 to which the present invention is applied.
A CPU (Central Processing Unit) 41 controls the operation of the remote commander 1, and controls the infrared transmitter 12 based on the user's operation input supplied from the track pad 11, and the user's operation input. Infrared signal corresponding to is transmitted, and lighting of the error display LED 13 is controlled. The memory 41 stores a program corresponding to a process executed by the CPU 41, information necessary for a process executed by the CPU 41, and the like.
FIG. 3 is a hardware block diagram of the television receiver 2 to which the present invention is applied.
The CPU 61 controls the operation of the television receiver 2. The CPU 61 transmits a signal indicating the user's operation input transmitted from the remote commander 1 and received by the infrared receiver 21, and the user using the operation input unit 62. The tuner 63, the image processing unit 64, the display control unit 65, the sound processing unit 66, and the power supply control unit 69 are controlled on the basis of the operation input performed by.
Based on the control of the CPU 61, the tuner 63 receives a broadcast signal (for example, an RF modulation signal) captured by a reception antenna (not shown), a broadcast signal acquired via a predetermined cable, or content data. Then, channel selection processing, intermediate frequency amplification processing, detection processing, and the like are performed to extract a video signal and supply it to the image processing unit 64, and an audio signal is extracted and supplied to the audio processing unit 66.
Based on the control of the CPU 61, the image processing unit 64 performs, for example, decoding processing, color demodulation (composite signal that is a carrier color signal into a component signal that is a color difference signal) on the video signal supplied from the tuner 63. And the like, processing necessary for the acquired video signal, such as synchronization and separation processing, is supplied to the display control unit 65. The display control unit 65 controls the display of the supplied processed video signal on the display unit 22, and controls the display on the display unit 22 such as a menu screen or a message screen based on the control of the CPU 61. To do.
Under the control of the CPU 61, the audio processing unit 66 performs, for example, decoding processing, noise removal processing, signal amplification processing, and the like on the audio signal supplied from the tuner 63 and supplies the audio signal to the speaker 67. The speaker 67 outputs the supplied audio data.
The storage unit 68 stores a program corresponding to the process executed by the CPU 61, information necessary for the process executed by the CPU 61, and the like. The power supply control unit 69 controls on / off of the power supply of the television receiver 2 based on the control of the CPU 61.
Further, a drive 70 is connected to the CPU 61 as necessary. A magnetic disk 71, an optical disk 72, a magneto-optical disk 73, a semiconductor memory 74, or the like is appropriately installed in the drive 70, and a computer program read from these is installed in the storage unit 68 as necessary.
Although not shown in FIG. 3, the video signal displayed on the display unit 22 and the audio signal output from the speaker 67 are connected to a predetermined cable from another device (for example, a video deck). Via a radio communication or via a wireless communication, or a broadcast signal selected by an external tuner may be acquired.
FIG. 4 is a functional block diagram for explaining functions relating to a part that receives signals from the remote commander 1 and the remote commander 1 of the television receiver 2 and receives a user operation input.
The remote commander 1 has functions executed by an operation input acquisition unit 91, an operation analysis processing unit 92, a state management processing unit 93, an LED control unit 94, a signal pattern generation processing unit 95, and an infrared transmission unit 96.
The operation input acquisition unit 91 acquires an operation input made on the track pad 11 and supplies the operation input to the operation analysis processing unit 92. The operation analysis processing unit 92 analyzes the operation acquired by the operation input acquisition unit 91, determines whether or not the user's operation is associated with a predetermined function, and uses the analysis result as a state management process. Supplied to the unit 93. The state management processing unit 93 manages the state of the input mode based on the operation analysis result by the operation analysis processing unit 92 and notifies the operation analysis processing unit 92 of the change of the input mode. In addition, when the user's operation input is not associated with a predetermined function, the state management processing unit 93 notifies the LED control unit 94 of the occurrence of an error, and when associated with the predetermined function, Information indicating whether the corresponding operation input has been performed is supplied to the signal pattern generation processing unit 95. When receiving an error occurrence notification from the state management processing unit 93, the LED control unit 94 controls the lighting of the error display LED 13. The signal pattern generation processing unit 95 acquires an infrared signal pattern to be transmitted to the television receiver 2 based on the information supplied from the state management processing unit 93 and supplies it to the infrared transmission unit 96. The infrared transmitter 96 transmits the infrared signal of the pattern acquired by the signal pattern generation processor 95 to the television receiver 2.
The television receiver 2 includes an infrared receiving unit 101, a signal pattern analysis processing unit 102, an operation control unit 103, a GUI output control unit 104, a volume control processing unit 105, an input source control processing unit 106, a cursor movement control processing unit 107, It has functions executed by the power control processing unit 108, the channel control processing unit 109, and the setting menu control processing unit 110.
The infrared receiving unit 101 receives the infrared signal transmitted from the remote commander 1 and supplies it to the signal pattern analysis processing unit 102. The signal pattern analysis processing unit 102 specifies a function corresponding to a user operation input based on the received infrared signal pattern, and supplies information indicating the result to the operation control unit 103. Based on the information indicating the function corresponding to the user's operation input, the operation control unit 103 is based on the GUI output control unit 104, the volume control processing unit 105, the input source control processing unit 106, the cursor movement control processing unit 107, and the power control processing. Control unit 108, channel control processing unit 109, and setting menu control processing unit 110. Based on the control of the operation control unit 103, the GUI output control unit 104 controls the display on the display unit 22 of the GUI for prompting the user's operation input or notifying the user of the operation content.
The sound volume control processing unit 105 controls the volume of sound output from the speaker 67 based on the control of the operation control unit 103. Based on the control of the operation control unit 103, the input source control processing unit 106 is a television receiver such as an external input from, for example, terrestrial analog, terrestrial digital, satellite broadcasting, cable television, or a video deck. Controls the change of the input source of the signal to the machine 2. The cursor movement control processing unit 107 controls the movement of the free cursor displayed on the display unit 22 based on the control of the operation control unit 103. Based on the control of the operation control unit 103, the power control processing unit 108 controls on / off of the power of the television receiver 2 by the power control unit 69. The channel control processing unit 109 controls channel selection by the tuner 63 (or an external tuner connected to the television receiver 2) at the time of receiving a television broadcast based on the control of the operation control unit 103. The setting menu control processing unit 110 controls various setting menus based on the control of the operation control unit 103.
Next, with reference to FIG. 5, the division of the area of the track pad 11 and the operation input acquisition performed on the track pad 11 by the operation input acquisition unit 91 will be described.
For example, as shown in FIG. 5A, the operation input acquisition unit 91 virtually divides the area of the track pad 11 into eight in the circumferential direction, and also has a predetermined radius range near the center (of the track pad 11). For example, a sufficiently small range such as 1/3 to 1/4 with respect to the radius is defined as one area, and is divided into a total of 9 areas.
Then, the operation input acquisition unit 91 is described as an example in which the operation is performed at predetermined intervals such as 100 ms (here, at intervals of 100 ms) between the time when the user's finger or the like touches the track pad 11 and leaves. However, this interval may be an arbitrary value (the same applies hereinafter)), and it continues to acquire in which of the eight areas the user's finger exists. The operation input acquisition unit 91 discards the information if the user's finger or the like is present in the same area even after 100 ms has elapsed, leaves only the information when the area has changed, and the user's finger or the like remains on the trackpad. Information indicating which region of the nine regions in FIG. 5A is moved by the position touching 11 is acquired. That is, the operation input acquisition unit 91 can obtain a list of areas where the user's finger or the like has moved on the trackpad 11 when the user's finger or the like has moved away from the trackpad 11.
For example, when the user's finger or the like moves in the order of a8, a9, a5, a9, a2 in the virtual nine areas of the trackpad 11 shown in FIG. The information indicating that the finger has moved in the order of a8, a9, a5, a9, a2 is supplied to the operation analysis processing unit 92.
The area dividing method shown in FIG. 5A is preferably used, for example, when an operation input made on the track pad 11 is an operation input for designating a function, for example.
Further, for example, as illustrated in FIG. 5B, the operation input acquisition unit 91 may virtually divide the area of the track pad 11 into 16 in the circumferential direction. The operation input acquisition unit 91 determines which region of the 16 regions the user's finger is in every predetermined period of time, for example, 100 ms, after the user's finger touches the track pad 11 and leaves. Keep getting what is present. The operation input acquisition unit 91 discards the information if the user's finger or the like is present in the same area even after 100 ms has elapsed, leaves only the information when the area has changed, and the user's finger or the like remains on the trackpad. The information which shows which area | region which the position touching 11 is moving among 16 areas of FIG. 5B is acquired. Then, the operation input acquisition unit 91 is information that sequentially indicates the area where the user's finger or the like has moved on the trackpad 11, or the moving direction (clockwise or counterclockwise) and the moving amount (moving to the adjacent area) To the operation analysis processing unit 92.
The area dividing method shown in FIG. 5B is used, for example, when the operation input made on the track pad 11 is an operation input for designating a change amount of a predetermined value such as an audio volume. Is preferable.
Further, for example, as shown in FIG. 5C, the operation input acquisition unit 91 virtually divides the area of the track pad 11 into four in the circumferential direction, and also has a predetermined radius range near the center (track pad For example, a sufficiently small range such as 1/3 to 1/4 with respect to the radius of 11 may be divided into a total of 5 areas. The operation input acquisition unit 91 determines which area of the five areas the user's finger is in every predetermined period of time, for example, 100 ms, after the user's finger touches the track pad 11 and leaves. Continue to get what is present. The operation input acquisition unit 91 discards the information if the user's finger or the like is present in the same area even after 100 ms has elapsed, leaves only the information when the area has changed, and the user's finger or the like remains on the trackpad. Information indicating which region of the five regions in FIG. 5C is moved by the position touching 11 is acquired. Then, the operation input acquisition unit 91 supplies the operation analysis processing unit 92 with information indicating the areas where the user's finger or the like has moved on the trackpad 11 in order.
The area dividing method shown in FIG. 5C is, for example, when the operation input made on the track pad 11 is an operation input corresponding to the operation of the cross button in a conventional remote commander such as menu selection, for example. It is preferable to use it.
In this way, the signal indicating the operation input to the track pad 11 by the user acquired by the operation input acquisition unit 91 is supplied to the operation analysis processing unit 92.
Then, the operation analysis processing unit 92 analyzes the operation acquired by the operation input acquisition unit 91 and supplies the analysis result to the state management processing unit 93. Based on the operation analysis result by the operation analysis processing unit 92, the state management processing unit 93 determines whether the user operation is associated with a predetermined function and manages the state of the input mode. Next, an example of a correspondence relationship between a user operation input and a function will be described with reference to FIG.
When the operation acquired by the operation input acquisition unit 91 is an operation of tracing the track pad 11 substantially once as shown in FIG. 6A, the operation input may be clockwise. For example, it corresponds to the function of turning on the power of the television receiver 2, and if it is counterclockwise, it is determined to correspond to the function of turning off the power of the television receiver 2. In addition, the operation analysis processing unit 92 rotates clockwise or counterclockwise when the operation acquired by the operation input acquisition unit 91 is an operation of tracing the track pad 11 substantially once as shown in FIG. 6A. Regardless of whether the power is currently turned on, it corresponds to the function to turn off the power if the power is currently on, and corresponds to the function to turn on the power if the power is currently off. May be determined.
The state management processing unit 93 sends, to the signal pattern generation processing unit 95, information indicating that the operation input corresponding to the power on / off command of the television receiver 2 supplied from the operation analysis processing unit 92 has been performed. Supply. The signal pattern generation processing unit 95 acquires the pattern of the infrared signal transmitted to the television receiver 2 based on the information supplied from the state management processing unit 93, supplies the pattern to the infrared transmission unit 96, and transmits the infrared signal. The unit 96 transmits an infrared signal to the television receiver 2.
In the television receiver 2 that has received the infrared signal from the remote commander 1 by the infrared receiving unit 101, the signal pattern analysis processing unit 102 responds to the user's operation input based on the received infrared signal pattern. The function is specified, and information indicating the result is supplied to the operation control unit 103. Then, the operation control unit 103 controls the power control processing unit 108 based on information indicating that the function corresponding to the user's operation input is a command to turn on / off the power of the television receiver 2, and The power of the John receiver 2 is turned on / off (the CPU 61 controls the power control unit 69).
Further, when the operation acquired by the operation input acquiring unit 91 is an input of a locus that draws a V-shape on the track pad 11 as shown in FIG. 6B, the operation analysis processing unit 92 performs the operation. Assume that the input corresponds to the function of changing the channel of the television receiver 2. The state management processing unit 93 supplies information indicating that the operation input corresponding to the channel change command supplied from the operation analysis processing unit 92 has been performed to the signal pattern generation processing unit 95 and sets the input mode. Assuming that it is the change amount input mode, the next operation input by the user is recognized as an operation for changing the channel, and the operation analysis processing unit 92 is notified of the change of the input mode. The signal pattern generation processing unit 95 acquires an infrared signal pattern to be transmitted to the television receiver 2 based on the information supplied from the state management processing unit 93, and supplies the infrared signal pattern to the infrared transmission unit 96. 96 transmits an infrared signal to the television receiver 2.
In the television receiver 2 that has received the infrared signal from the remote commander 1 by the infrared receiving unit 101, the signal pattern analysis processing unit 102 responds to the user's operation input based on the received infrared signal pattern. The function is specified, and information indicating the result is supplied to the operation control unit 103. Then, the operation control unit 103 controls the GUI output control unit 104 based on information indicating that the function corresponding to the user's operation input is a channel change command, and the channel control as shown in FIG. A change amount input GUI screen having the value as a change amount is displayed on the display unit 22. The change amount input GUI screen shown in FIG. 7 that uses the channel value as the change amount intuitively correlates the user's operation input with the track pad 11 with the change in the channel value. Are displayed in a circle.
When the user traces the track pad 11 in the right direction in this state, information on the amount of change corresponding to the user's operation input is obtained by the processing of the operation input acquisition unit 91, the operation analysis processing unit 92, and the state management processing unit 93. Is transmitted to the television receiver 2, the operation control unit 103 that has received the signal corresponding to the user operation input controls the channel control processing unit 109 in the same manner as described above. The channel is changed according to the distance the user traces the track pad 11 (the selection of the broadcast signal by the tuner 63 is controlled by the CPU 61).
Then, the operation control unit 103 controls the GUI output control unit 104 to change the display of the GUI screen displayed on the display unit 22. For example, in a state where the television receiver 2 currently receives a 4ch broadcast signal and displays on the GUI screen displayed on the display unit 22 that the 4ch broadcast signal is being received, When the user performs an operation input to rotate the contact point such as a finger once in the right rotation on the track pad 11 of the remote commander 1, the broadcast signal received by being selected by the tuner 63 of the television receiver 2 is On the GUI screen displayed on the display unit 22 after being changed to 8ch, it is displayed that the 8ch broadcast signal is being received. In addition, when the user changes the contact point of a finger or the like on the track pad 11 of the remote commander 1 by left rotation, the number of the received channel is changed in a decreasing direction.
In addition, the operation analysis processing unit 92 receives an operation acquired by the operation input acquisition unit 91 by inputting a trajectory for drawing a figure obtained by vertically inverting a V-shape with a single stroke on the track pad 11 as shown in FIG. 6C. If so, it is assumed that the operation input corresponds to the function of changing the volume of the sound output from the television receiver 2. The state management processing unit 93 supplies information indicating that the operation input corresponding to the volume change command supplied from the operation analysis processing unit 92 has been performed to the signal pattern generation processing unit 95 and sets the input mode. Assuming that it is the change amount input mode, the next operation input by the user is recognized as an operation for changing the sound volume, and the operation analysis processing unit 92 is notified of the change of the input mode. The signal pattern generation processing unit 95 acquires an infrared signal pattern to be transmitted to the television receiver 2 based on the information supplied from the state management processing unit 93, and supplies the infrared signal pattern to the infrared transmission unit 96. 96 transmits an infrared signal to the television receiver 2.
In the television receiver 2 that has received the infrared signal from the remote commander 1 by the infrared receiving unit 101, the signal pattern analysis processing unit 102 responds to the user's operation input based on the received infrared signal pattern. The function is specified, and information indicating the result is supplied to the operation control unit 103. Then, the operation control unit 103 controls the GUI output control unit 104 based on information indicating that the function corresponding to the user's operation input is a change in the volume of the audio output, as shown in FIG. A GUI screen for inputting the change amount is displayed on the display unit 22 with the numerical value corresponding to the volume as the change amount. The change amount input GUI screen shown in FIG. 8 that uses the numerical value corresponding to the volume as the change amount is to intuitively associate the user's operation input with the track pad 11 with the change in the value of the audio volume. The graphic indicating the volume of the audio volume is displayed so as to surround the numeral indicating the volume, and displayed in a circle.
When the user traces the track pad 11 by rotating to the right in this state, information on the amount of change corresponding to the user's operation input is obtained by the processing of the operation input acquisition unit 91, operation analysis processing unit 92, and state management processing unit 93. Is transmitted to the television receiver 2, the operation control unit 103 that has received the signal corresponding to the user's operation input controls the volume control processing unit 105 in the same manner as described above. The sound output volume is increased according to the distance the user traces the track pad 11 (the amount of sound data amplified by the sound processing unit 66 is controlled by the CPU 61). Similarly, when the user traces the track pad 11 by rotating counterclockwise in this state, the operation control unit 103 that has received a signal corresponding to the user's operation input controls the volume control processing unit 105. The volume of the audio output is reduced according to the distance the user traces the track pad 11.
Then, the operation control unit 103 controls the GUI output control unit 104 to change the display of the GUI screen displayed on the display unit 22. For example, at present, the television receiver 2 outputs sound at a volume corresponding to a value 12 that defines a predetermined volume, and the volume corresponding to the value 12 on the GUI screen displayed on the display unit 22. When a user performs an operation input by tracing with the finger or the like on the track pad 11 of the remote commander 1 while displaying that the sound is being output, the television receiver 2 The volume of audio data output from the speaker 67 is increased by controlling the amount of audio data amplified by the audio processing unit 66, and a numerical value indicating the volume of audio output on the GUI screen displayed on the display unit 22. Is displayed. Further, when the user changes the contact point of a finger or the like on the track pad 11 of the remote commander 1 by left rotation, the output sound volume and the numerical value indicating the displayed sound volume are in a decreasing direction. Changed.
In addition, when the operation acquired by the operation input acquiring unit 91 is an input of a trajectory of drawing> on the track pad 11 as shown in FIG. 6D, the operation analysis processing unit 92 inputs the operation input. Is assumed to correspond to the function of changing the input source of data acquired by the television receiver 2. The state management processing unit 93 supplies information indicating that the operation input corresponding to the input source change command supplied from the operation analysis processing unit 92 has been performed to the signal pattern generation processing unit 95, and the input mode. Is the change amount input mode, the next operation input by the user is recognized as an operation for changing the input source, and the operation analysis processing unit 92 is notified of the change of the input mode. The signal pattern generation processing unit 95 acquires an infrared signal pattern to be transmitted to the television receiver 2 based on the information supplied from the state management processing unit 93, and supplies the infrared signal pattern to the infrared transmission unit 96. 96 transmits an infrared signal to the television receiver 2.
In the television receiver 2 that has received the infrared signal from the remote commander 1 by the infrared receiving unit 101, the signal pattern analysis processing unit 102 responds to the user's operation input based on the received infrared signal pattern. The function is specified, and information indicating the result is supplied to the operation control unit 103. Then, the operation control unit 103 controls the GUI output control unit 104 based on the information indicating that the function corresponding to the user's operation input is the change of the input source, and the input source as shown in FIG. A GUI screen for receiving the change command is displayed on the display unit 22. The GUI screen for receiving the input source change command shown in FIG. 9 intuitively correlates the user's operation input with the trackpad 11 and the change of the input source. They are displayed side by side in a circle.
When the user traces the track pad 11 by rotating to the right in this state, information on the amount of change corresponding to the user's operation input is obtained by the processing of the operation input acquisition unit 91, operation analysis processing unit 92, and state management processing unit 93. Is transmitted to the television receiver 2, the operation control unit 103 receiving the signal corresponding to the user operation input controls the input source control processing unit 106 in the same manner as described above. The input source is changed according to the distance and the direction in which the user traces the track pad 11.
Then, the operation control unit 103 controls the GUI output control unit 104 to change the display of the GUI screen displayed on the display unit 22. For example, the television receiver 2 currently selects the terrestrial television broadcast as the input source, and the terrestrial television broadcast is selected as the input source on the GUI screen displayed on the display unit 22. When the user performs an operation input for rotating a contact point such as a finger to the right on the track pad 11 of the remote commander 1, the input source of the television receiver 2 is the terrestrial TV, BS, CATV, video input 1, video input 2, video input 3, and terrestrial TV are sequentially switched in this order. On the GUI screen displayed on the display unit 22, the text corresponding to the currently specified input source is, for example, It is displayed so as to be distinguishable from other text data by highlight display, enlarged display, or color reversal display. In addition, when the user changes the contact point of a finger or the like on the track pad 11 of the remote commander 1 by left rotation, the switching of the input source is changed in the reverse order as described above.
Further, when the operation acquired by the operation input acquiring unit 91 is an input of a trajectory of drawing <on the track pad 11 as shown in FIG. 6E, the operation analysis processing unit 92 inputs the operation input. Corresponds to the function for calling the setting menu. The state management processing unit 93 supplies the signal pattern generation processing unit 95 with information indicating that the operation input corresponding to the command for calling the setting menu supplied from the operation analysis processing unit 92 has been performed, and the input mode Is the cross button mode, the next operation input by the user is recognized as an operation for changing the setting menu, and the operation analysis processing unit 92 is notified of the change of the input mode. The signal pattern generation processing unit 95 acquires an infrared signal pattern to be transmitted to the television receiver 2 based on the information supplied from the state management processing unit 93, and supplies the infrared signal pattern to the infrared transmission unit 96. 96 transmits an infrared signal to the television receiver 2.
In the television receiver 2 that has received the infrared signal from the remote commander 1 by the infrared receiving unit 101, the signal pattern analysis processing unit 102 responds to the user's operation input based on the received infrared signal pattern. The function is specified, and information indicating the result is supplied to the operation control unit 103. Then, the operation control unit 103 controls the GUI output control unit 104 based on the information indicating that the function corresponding to the user's operation input is calling the setting menu, and the setting menu as shown in FIG. Is displayed on the display unit 22.
When the user operates the trackpad 11 in this state, information on the amount of change corresponding to the user's operation input is displayed on the television by the operations of the operation input acquisition unit 91, the operation analysis processing unit 92, and the state management processing unit 93. Since it is transmitted to the John receiver 2, the operation control unit 103 that has received the signal corresponding to the user's operation input controls the GUI output control unit 104 and displays it on the display unit 22 in the same manner as described above. The display of the displayed GUI screen is changed.
For example, the television receiver 2 currently displays that the item 1 is selected as the setting menu and that the item 1 is selected as the setting menu on the GUI screen displayed on the display unit 22. In this state, when the user traces the track pad 11 of the remote commander 1 downward from the center, the cursor on the menu displayed on the display unit 22 moves to the next lower item and traces upward from the center. The cursor on the menu moves to the next item up, and if you trace from the center to the right, the cursor on the menu moves to the item to the right, and if you trace from the center to the left, the cursor on the menu Moves one item to the left. Then, when the user taps the track pad 11 of the remote commander 1 (touching the track pad and releasing it without moving from that position), the item with the current cursor is selected (setting menu is changed). ). Then, the operation control unit 103 controls the setting menu control processing unit 110 to change the setting menu according to the operation input to the track pad 11 by the user.
In addition, the operation analysis processing unit 92 performs an input in which the operation acquired by the operation input acquiring unit 91 moves the finger or the like touching the track pad 11 from the left direction to the right direction as shown in FIG. 6F. In this case, it is assumed that the operation input corresponds to a function for operating the free cursor. The state management processing unit 93 supplies the signal pattern generation processing unit 95 with information indicating that an operation input corresponding to a command for calling a function for operating the free cursor supplied from the operation analysis processing unit 92 has been performed. At the same time, assuming that the input mode is the free cursor mode, the next operation input by the user is recognized as an operation for changing the cursor position, and the operation analysis processing unit 92 is notified of the change of the input mode. . The signal pattern generation processing unit 95 acquires an infrared signal pattern to be transmitted to the television receiver 2 based on the information supplied from the state management processing unit 93, and supplies the infrared signal pattern to the infrared transmission unit 96. 96 transmits an infrared signal to the television receiver 2.
In the television receiver 2 that has received the infrared signal from the remote commander 1 by the infrared receiving unit 101, the signal pattern analysis processing unit 102 responds to the user's operation input based on the received infrared signal pattern. The function is specified, and information indicating the result is supplied to the operation control unit 103. Then, the operation control unit 103 controls the cursor movement control processing unit 107 based on information indicating that the function corresponding to the user's operation input is a free cursor operation, as shown in FIG. The user can arbitrarily position the display unit 22 that displays a setting screen that can be set by a free cursor, or the display unit 22 in a state where the bidirectional communication function or the web browser function is used. A cursor 111 that can be moved is displayed.
When the user operates the track pad 11 in this state, information on the amount of change corresponding to the user's operation input is obtained by the operations of the operation input acquisition unit 91, the operation analysis processing unit 92, and the state management processing unit 93. Since it is transmitted to the John receiver 2, the operation control unit 103 that has received the signal corresponding to the user's operation input controls the cursor movement control processing unit 107 and controls the display unit 22 in the same manner as described above. The display position of the cursor 111 displayed on is changed.
Then, when the user taps the track pad 11 of the remote commander 1 (the operation of touching the track pad and releasing it without moving from that position), the item with the current cursor is selected. Then, the operation control unit 103 controls the cursor movement control processing unit 107 to execute processing according to an operation input to the track pad 11 by the user.
As described above, the user's operation input (trajectory drawn on the track pad 11 using a finger or the like) described with reference to FIGS. 6 to 11 and the function to be read out correspond to each other. Specifically, for example, it is assumed that the user's finger or the like moves in the order of a8, a9, a5, a9, and a2 in the virtual nine areas of the trackpad 11 shown in FIG. 5A. Since the movement of the user's finger or the like at this time is V-shaped, the operation analysis processing unit 92 detects that the user is instructing a function of changing the channel of the television receiver 2, Since the information indicating the function called by the user is supplied to the state management processing unit 93, the state management processing unit 93 changes the input mode and notifies the operation analysis processing unit 92. Therefore, the operation analysis processing unit 92 It is recognized that the next operation input is a change amount input for changing the channel.
Note that the operation analysis processing unit 92 may store in advance a table indicating a correspondence relationship between a user's operation input (a trajectory drawn on the track pad 11 using a finger or the like) and a read function. In this table, for example, in the virtual nine areas of the track pad 11 shown in FIG. 5A, movement areas such as a user's finger are (a8, a9, a5, a9, a2) or (a8, a9, The function corresponding to the case of a2) is a channel change, and the function corresponding to the case where the movement area of the user's finger or the like is (a9, a9, a1, a9, a4) or (a6, a9, a4) However, it is registered in advance that the volume is changed. The operation analysis processing unit 92 can detect a function instructed by the user by referring to the table.
When the operation analysis processing unit 92 cannot detect a function corresponding to the user's operation input, the operation analysis processing unit 92 notifies the state management processing unit 93 of that, so the state management processing unit 93 controls the LED control unit 94 to detect an error. The display LED 13 is turned on, and re-input from the user is waited without changing the input mode.
The correspondence relationship between the user's operation input (drawn figure) and the function described with reference to FIGS. 6 to 11 shows an example, and the function called by the user's operation input is a pair. If it can be determined by 1, this need not be the case, and it goes without saying that various patterns can be considered.
Next, state management of operation input in the state management processing unit 93 will be described with reference to the state transition diagram of FIG.
For example, it is assumed that the user is watching a broadcast program of a certain channel of a television broadcast by a certain input source on the television receiver 2. At this time, the state of the remote commander 1 managed by the state management processing unit 93 is the “first stage input standby state” in the state transition diagram of FIG. In the “first stage input standby state”, it is preferable that the operation input acquisition unit 91 uses the area dividing method described with reference to FIG. 5A as the area dividing method of the track pad 11.
Here, when the user performs an operation input for tracing the track pad 11 in a V-shape, the operation analysis processing unit 92 indicates that the user has instructed a function of changing the channel of the television receiver 2. Since it is detected and supplied to the state management processing unit 93, the state management processing unit 93 changes the input mode to the “change amount input mode” and notifies the operation analysis processing unit 92.
In the “change amount input mode”, it is preferable that the operation input obtaining unit 91 uses the region dividing method described with reference to FIG. 5B as the region dividing method of the track pad 11.
The operation analysis processing unit 92 performs the user's operation input every 100 ms based on the information indicating the user's operation input supplied from the operation input acquisition unit 91 in the “second stage input standby state” in the “change amount input mode”. Monitor how much the area touched by the finger has changed and how many areas have been moved, and if the trajectory drawn by the user's finger etc. is at least part of the clockwise circumference, the channel Identifies that the function to change the number in the direction of increasing numbers is called, and if it is at least part of the counterclockwise circumference, specifies that the function to change the channel in the direction of decreasing numbers is called and The amount of channel change is detected based on the amount of movement and is supplied to the state management processing unit 93. For example, when the region corresponding to the position where the user's finger touches the track pad 11 moves from the region b8 to the region b12 in the region dividing method described with reference to FIG. It is defined as a command to increase the corresponding value by two channels. The state management processing unit 93 supplies information related to the channel change to the signal pattern generation processing unit 95 and sets the state again to the “first stage input standby state”. Then, the signal pattern generation processing unit 95 acquires an infrared signal pattern transmitted to the television receiver 2 based on the information supplied from the state management processing unit 93, supplies the infrared signal pattern to the infrared transmission unit 96, and transmits the infrared signal. The transmitter 96 transmits an infrared signal to the television receiver 2.
Further, the state of the remote commander 1 managed by the state management processing unit 93 is the “first stage input standby state” in the state transition diagram of FIG. 12, and the user flips the track pad 11 upside down. When the drawn figure is drawn or when an operation input tracing the shape of> is performed, the input mode is changed to the change amount input mode in the same manner as described above.
Further, the state of the remote commander 1 managed by the state management processing unit 93 is the “first stage input standby state” in the state transition diagram of FIG. 12, and the user traces the track pad 11 in the shape of <. When the operation input is performed, the operation analysis processing unit 92 detects that the user has instructed to call the setting menu, and supplies it to the state management processing unit 93. Is changed to the “cross button mode”, and the operation analysis processing unit 92 is notified.
In the “cross button mode”, it is preferable that the operation input acquisition unit 91 uses the region dividing method described with reference to FIG. 5C as the region dividing method of the track pad 11.
In the “second stage input standby state” in the “cross button mode”, the operation analysis processing unit 92 is based on the information indicating the user's operation input supplied from the operation input acquisition unit 91, and the user's If it is detected that tapping has been performed while identifying the menu selected by the user by monitoring how much the area touched by etc. has changed and how many areas have been moved, The state management processing unit 93 detects that an operation input for confirming the selected menu has been performed, and changes the state to the “first stage input standby state” again. Then, the signal pattern generation processing unit 95 acquires an infrared signal pattern transmitted to the television receiver 2 based on the information supplied from the state management processing unit 93, supplies the infrared signal pattern to the infrared transmission unit 96, and transmits the infrared signal. The transmitter 96 transmits an infrared signal to the television receiver 2.
Further, the state of the remote commander 1 managed by the state management processing unit 93 is the “first stage input standby state” in the state transition diagram of FIG. 12, and the user touches the trackpad 11 with a finger or the like. When an input for moving from the left direction to the right direction is performed, the operation analysis processing unit 92 detects that the user is instructing the free cursor mode and supplies it to the state management processing unit 93. The unit 93 changes the input mode to “free cursor mode” and notifies the operation analysis processing unit 92 of the input mode.
In the “second stage input standby state” in the “free cursor mode”, the operation analysis processing unit 92 uses the information indicating the user's operation input supplied from the operation input acquisition unit 91 every 100 ms. When it is detected that tapping has been performed while identifying the direction and amount of movement of the cursor by monitoring how much the area touched by etc. has changed and how many areas have been moved , It is detected that an operation input for confirming the selected item has been performed, and the detected item is supplied to the state management processing unit 93. The state management processing unit 93 supplies information related to the movement of the free cursor to the signal pattern generation processing unit 95, and sets the state again to the “first stage input standby state”. Then, the signal pattern generation processing unit 95 acquires an infrared signal pattern transmitted to the television receiver 2 based on the information supplied from the state management processing unit 93, supplies the infrared signal pattern to the infrared transmission unit 96, and transmits the infrared signal. The transmitter 96 transmits an infrared signal to the television receiver 2.
Further, the state of the remote commander 1 managed by the state management processing unit 93 is the “first stage input standby state” in the state transition diagram of FIG. 12, and the user performs an operation of tracing the track pad 11 substantially once. When input is made, the operation analysis processing unit 92 detects that the user has instructed to turn on / off the power of the television receiver 2 and supplies it to the state management processing unit 93. Therefore, the state management processing unit 93 Supplies the signal pattern generation processing unit 95 with information indicating that the operation input corresponding to the power ON / OFF command has been performed while keeping the input mode in the “first stage input standby state”. The signal pattern generation processing unit 95 acquires the pattern of the infrared signal transmitted to the television receiver 2 based on the information supplied from the state management processing unit 93, supplies the pattern to the infrared transmission unit 96, and transmits the infrared signal. The unit 96 transmits an infrared signal to the television receiver 2.
By the way, in the “second stage input standby state” in the “change amount input mode”, the change amount is input every 100 ms as to whether the area touched by the user's finger or the like on the track pad 11 has changed. The movement of the minute area is monitored, and the trajectory drawn by the user's finger etc. is determined according to whether it is at least part of the clockwise circle or at least part of the counterclockwise circle. The function is called and the change amount of the predetermined value is detected according to the movement amount of the area. For example, in the “second stage input standby state” in the “change amount input mode”, the trackpad 11 The user may be able to instruct the amount of change by drawing the shape of a number or character with a finger or the like. In this case, the user's explanation described with reference to FIG. 6 does not become difficult to distinguish from the input of the change amount based on the movement amount of the trajectory (region change amount) by the user's finger as described above. It is preferable to perform the input by defining the correspondence between the operation input of the user and the function, which can be distinguished from the correspondence between the operation input and the function.
When the operation acquired by the operation input acquisition unit 91 is, for example, an operation input in which a figure obtained by vertically inverting a triangle is drawn, the operation receiver 92 acquires the operation input. It is assumed that it corresponds to the function of commanding the input source of data to be changed and the change of the channel to be selected. The state management processing unit 93 uses the signal pattern generation processing to display information indicating that an operation input corresponding to the input source and the channel change command supplied from the operation analysis processing unit 92 has been performed. The input mode is the character / number input mode, and the next input operation by the user is recognized as a character or number for designating the input source and channel, The operation analysis processing unit 92 is notified of the input mode change. The signal pattern generation processing unit 95 acquires an infrared signal pattern to be transmitted to the television receiver 2 based on the information supplied from the state management processing unit 93, and supplies the infrared signal pattern to the infrared transmission unit 96. 96 transmits an infrared signal to the television receiver 2.
In the television receiver 2 that has received the infrared signal from the remote commander 1 by the infrared receiving unit 101, the signal pattern analysis processing unit 102 responds to the user's operation input based on the received infrared signal pattern. The function is specified, and information indicating the result is supplied to the operation control unit 103. Then, the operation control unit 103 controls the GUI output control unit 104 based on information indicating that the function corresponding to the user's operation input is an input source and a change of a channel to be selected, and FIG. A GUI screen for receiving a command to change the input source and the channel to be selected as shown in FIG.
In this case, the display screen displays information indicating the current input source and channel, and information indicating the input source and channel input by the user in the second stage input, and supports operation input by the user. For example, when inputting a terrestrial television, input a number directly, and when selecting BS broadcasting, first input “B” and input a channel number to the right (for example, “B7”). ), When selecting cable TV, first input "C" and input the channel number to the right (for example, "C20"). When selecting video input, input "V" at the beginning. A description of an input method such as inputting a terminal number to the right (for example, “V2” when selecting video input 2) is displayed.
Note that a method for detecting characters and numbers drawn on the track pad 11 in the second stage input is described in, for example, Japanese Patent Application Laid-Open No. 11-184970, and the detailed description thereof is omitted.
When the user inputs characters or numbers into the trackpad 11 in this state, the operation input acquisition unit 91, the operation analysis processing unit 92, and the state management processing unit 93 process the character or number information in the user operation input. Is transmitted to the television receiver 2 character by character, so that the operation control unit 103, which has received a signal corresponding to the user's operation input, controls the input source control processing unit 106 in the same manner as described above. The input source is changed and the channel control processing unit 109 is controlled to change the channel of the received broadcast signal or the input terminal number. Then, the operation control unit 103 controls the GUI output control unit 104 to change the display of the GUI screen displayed on the display unit 22.
Here, depending on the input pattern, there is an input of one character and an input of two or more characters. However, in the same way as a character input method widely used in the past, after an input of one or more characters, it is specified. If the next character is not input after the elapse of time, it is recognized that the input is completed with one character. The time width of the specific time can be changed by the user. For example, about 0.5 seconds is appropriate. Specifically, the operation input acquisition unit 91, the operation analysis processing unit 92, and the state management processing unit 93, for example, after receiving “1” and not receiving an operation input for 0.5 seconds or more, The input character is “1”, and it is determined that the character input has been completed, and the state is changed to “first stage input standby state”. When the input of “0” is received on the right side of the input position of “”, the character input by the user is “10”, and it is determined that the input of the character has been completed, and the state is in the “first stage input standby state” Transition. If the state management processing unit 93 determines that the input of characters has been completed, the state management processing unit 93 causes the television receiver 2 to notify it. That is, the signal pattern generation processing unit 95 acquires the pattern of the infrared signal transmitted to the television receiver 2 based on the information supplied from the state management processing unit 93, supplies the pattern to the infrared transmission unit 96, and transmits the infrared signal. The transmission unit 96 transmits an infrared signal indicating completion of character input to the television receiver 2.
Further, when the operation acquired by the operation input acquiring unit 91 is, for example, an operation input in which a triangle is drawn, the operation input is an audio output from the television receiver 2. It is assumed that this corresponds to the function of changing the volume. The state management processing unit 93 supplies information indicating that the operation input corresponding to the voice volume change command supplied from the operation analysis processing unit 92 has been performed to the signal pattern generation processing unit 95 and also inputs the information. Assuming that the mode is the character / number input mode, the next operation input by the user is recognized as an input operation of characters or numbers for changing the voice volume, and the operation analysis processing unit 92 is notified of the input mode. Notify changes. The signal pattern generation processing unit 95 acquires an infrared signal pattern to be transmitted to the television receiver 2 based on the information supplied from the state management processing unit 93, and supplies the infrared signal pattern to the infrared transmission unit 96. 96 transmits an infrared signal to the television receiver 2.
In the television receiver 2 that has received the infrared signal from the remote commander 1 by the infrared receiving unit 101, the signal pattern analysis processing unit 102 responds to the user's operation input based on the received infrared signal pattern. The function is specified, and information indicating the result is supplied to the operation control unit 103. Then, the operation control unit 103 controls the GUI output control unit 104 based on the information indicating that the function corresponding to the user operation input is the change of the audio volume, and the audio volume as shown in FIG. A GUI screen for receiving the change command is displayed on the display unit 22.
On the display screen in this case, information indicating a numerical value corresponding to the current audio volume and information indicating a numerical value corresponding to the audio volume input by the user in the second stage input are displayed. When the user inputs characters or numbers into the trackpad 11 in this state, the operation input acquisition unit 91, the operation analysis processing unit 92, and the state management processing unit 93 process the character or number information in the user operation input. Is transmitted to the television receiver 2, the operation control unit 103 receiving the signal corresponding to the user operation input controls the input source control processing unit 106 in the same manner as described above. Then, the sound volume control processing unit 105 is controlled to change the sound output volume. Then, the operation control unit 103 controls the GUI output control unit 104 to change the display of the GUI screen displayed on the display unit 22.
As the input mode, a “character / number input mode” is newly provided. In the “second stage input standby state” in the “character / number input mode”, the user can use a finger or the like on the track pad 11 to input numbers and characters. FIG. 15 shows a state transition diagram in the case where the change amount can be instructed in the same manner as in the “change amount input mode” by drawing a shape.
That is, the state transition diagram in FIG. 15 is basically the same as the state transition diagram described with reference to FIG. The same state transition is shown.
The state of the remote commander 1 managed by the state management processing unit 93 is the “first stage input standby state” in the state transition diagram of FIG. 15, and the user flips the triangle upside down with respect to the trackpad 11. When an operation input in which a figure or a triangle is drawn is performed, the operation analysis processing unit 92 is a function for the user to change an input source of data acquired by the television receiver 2 and a channel to be selected. Or detecting that an instruction to call a function for changing the volume of the output voice is issued and supplied to the state management processing unit 93, the state management processing unit 93 sets the input mode to “character / number input”. The operation analysis processing unit 92 is notified of the transition to “mode”.
The operation analysis processing unit 92 is configured to input characters based on the information indicating the user's operation input supplied from the operation input acquisition unit 91 in the “second stage input standby state” in the “character / number input mode”. Or detect numbers. Then, the signal pattern generation processing unit 95 acquires an infrared signal pattern transmitted to the television receiver 2 based on the information supplied from the state management processing unit 93, supplies the infrared signal pattern to the infrared transmission unit 96, and transmits the infrared signal. The transmitter 96 transmits an infrared signal to the television receiver 2. The state management processing unit 93 transitions the state again to the “first stage input standby state” on the assumption that the input of characters or numbers has been completed after a specific time has elapsed since the input of characters or numbers.
Next, the remote commander process 1 executed by the remote commander 1 described with reference to FIG. 4 will be described with reference to the flowchart of FIG.
In step S <b> 1, the operation input acquisition unit 91 determines whether or not the user's finger or the like has touched the track pad 11. In step S1, when it is determined that the user's finger or the like is not in contact with the track pad 11, the process of step S1 is repeated until it is determined that the user's finger or the like has contacted.
If it is determined in step S1 that the user's finger or the like has touched the track pad 11, in step S2, the operation input acquisition unit 91 acquires the coordinate information of the initial position where the user's finger or the like touched the track pad 11. To do.
In step S <b> 3, the operation input acquisition unit 91 acquires coordinate information (region information) indicating a position where the user's finger or the like is touching the track pad 11 every predetermined period (100 msec).
In step S <b> 4, the operation input acquisition unit 91 determines whether or not the user's finger or the like has been released from the track pad 11. If it is determined in step S4 that the user's finger or the like is not separated from the track pad 11, the process returns to step S3, and the subsequent processes are repeated.
When it is determined in step S4 that the user's finger or the like has moved away from the track pad 11, in step S5, the operation input acquisition unit 91 obtains a list of coordinates (regions) that the user's finger or the like has moved on the track pad 11. To the operation analysis processing unit 92. The operation analysis processing unit 92 analyzes a locus such as a user's finger supplied from the operation input acquisition unit 91.
In step S6, the operation analysis processing unit 92 extracts the user command content associated with the locus of the user's finger or the like based on the analysis result, as described with reference to FIG. 93.
In step S <b> 7, the state management processing unit 93 generates signal pattern information indicating information indicating which function input is performed in order to transmit the extracted user instruction content to the television receiver 2. This is supplied to the processing unit 95. The signal pattern generation processing unit 95 acquires an infrared signal pattern to be transmitted to the television receiver 2 based on the information supplied from the state management processing unit 93, and supplies the infrared signal pattern to the infrared transmission unit 96. 96 transmits an infrared signal to the television receiver 2.
In step S <b> 8, the state management processing unit 93 manages the state of the input mode based on the extracted user instruction content, changes the current input mode as necessary, and inputs it to the operation analysis processing unit 92. Notify mode change.
In step S <b> 9, the operation analysis processing unit 92 determines the user based on the list of coordinates (area) where the user's finger or the like has moved on the trackpad 11 and the input mode notified from the operation input acquisition unit 91. The operation input is acquired and supplied to the state management processing unit 93. The state management processing unit 93 manages the state of the input mode, and transmits the user instruction content to the television receiver 2 by the processing of the signal pattern generation processing unit 95 and the infrared transmission unit 96 as necessary.
In step S <b> 10, the state management processing unit 93 determines whether or not the input mode has ended based on the command content supplied from the operation analysis processing unit 92 and corresponding to the user's operation input. If it is determined in step S10 that the input mode has not ended, the process returns to step S9, and the subsequent processes are repeated in the same input mode. If it is determined in step S10 that the input mode has been completed, the state returns to the “first stage input standby state” again, so that the process returns to step S1 and the subsequent processes are repeated.
Through such processing, the user using the remote commander 1 uses the trackpad 11, which is only one input device, to select a function, input a value for the function, and a free cursor. It is possible to input an operation for moving.
Further, in the television receiver 2 that has received the infrared signal from the remote commander 1 by the infrared receiving unit 101, the signal pattern analysis processing unit 102 corresponds to a user operation input based on the received infrared signal pattern. The function is specified, and information indicating the result is supplied to the operation control unit 103. Then, based on the information indicating the function corresponding to the user's operation input, the operation control unit 103 is based on the GUI output control unit 104, the volume control processing unit 105, the input source control processing unit 106, the cursor movement control processing unit 107, the power source The control processing unit 108, the channel control processing unit 109, and the setting menu control processing unit 110 are appropriately controlled.
As described with reference to the state transition diagrams of FIGS. 12 and 15, in step S <b> 9 of FIG. 16, functions and command contents corresponding to user operation inputs are extracted based on various input modes, and the television is set. It is transmitted to the receiver 2. Next, as an example of processing in various input modes, processing in the change amount input mode of the remote commander 1 will be described with reference to the flowchart in FIG.
In step S <b> 21, the operation input acquisition unit 91 determines whether or not the user's finger or the like has touched the track pad 11. In step S1, when it is determined that the user's finger or the like is not in contact with the track pad 11, the process of step S1 is repeated until it is determined that the user's finger or the like has contacted.
If it is determined in step S21 that the user's finger or the like has touched the track pad 11, the operation input acquisition unit 91 acquires the coordinate information of the initial position where the user's finger or the like touched the track pad 11 in step S22. To do.
In step S <b> 23, the operation input acquisition unit 91 acquires coordinate information (region information) indicating a position where the user's finger or the like is touching the track pad 11 every predetermined period (100 msec).
In step S <b> 24, the operation input acquisition unit 91 determines whether or not the user's finger or the like has been released from the track pad 11. If it is determined in step S24 that the user's finger or the like is not separated from the track pad 11, the process returns to step S23, and the subsequent processes are repeated.
If it is determined in step S24 that the user's finger or the like has moved away from the trackpad 11, in step S25, the operation input acquisition unit 91 and the operation analysis processing unit 92 specify a function corresponding to the user's operation. That is, the operation input acquisition unit 91 obtains a list of coordinates (regions) where the user's finger or the like has moved on the track pad 11 and supplies the list to the operation analysis processing unit 92. The operation analysis processing unit 92 analyzes a locus such as a user's finger supplied from the operation input acquisition unit 91. Then, the operation analysis processing unit 92 corresponds to the input mode and the trajectory of the user's finger, such as channel change, audio volume change, or input source change, based on the analysis result (direction and change amount). The attached user command content is extracted and supplied to the state management processing unit 93.
In step S26, the state management processing unit 93 changes the amount of change corresponding to the operation input (change of channel, change of audio volume, or input) in order to transmit the extracted user command content to the television receiver 2. Information indicating source change) is supplied to the signal pattern generation processing unit 95. The signal pattern generation processing unit 95 acquires an infrared signal pattern to be transmitted to the television receiver 2 based on the information supplied from the state management processing unit 93 and supplies the infrared signal pattern to the infrared transmission unit 96. 96 transmits an infrared signal to the television receiver 2, and the process is terminated.
By such processing, the user using the remote commander 1 can perform operation input in each input mode using the track pad 11 which is only one input device.
By the way, in the process described above, in the “first stage input standby state”, when the user performs an input to move the finger touching the track pad 11 from the left direction to the right direction, the operation analysis processing unit 92 is Since it is detected that the user is instructing the free cursor mode and is supplied to the state management processing unit 93, the state management processing unit 93 has been described as transitioning the input mode to the “free cursor mode”. In the above-described embodiment, when it is detected that tapping has been performed, it is recognized that an operation input for confirming the selected item has been performed, and the state is again “wait for first stage input”. Return to state. Therefore, for example, the television receiver 2 has a bidirectional communication function, a web browsing function, or a function that uses a BML (Broadcast Markup Language) browser in digital broadcasting, and can continuously input a free cursor. If the performance is high, it is necessary to instruct the free cursor mode every time tapping is performed, and it is difficult to say that the operability is good.
Normally, a television receiver can determine whether or not the input of a free cursor is necessary. Therefore, when the input of the free cursor is necessary, the television receiver can send a remote commander to the remote commander. Alternatively, it may be notified that the operation input in the free cursor mode is received so that the input mode of the remote commander can be controlled.
FIG. 18 shows the functions of the remote commander 121 and the television receiver 122 when the television receiver can notify the remote commander that it is necessary to input a free cursor. It is a functional block diagram for demonstrating only the part corresponding to the process with respect to a user's operation input.
Note that portions corresponding to those described with reference to FIG. 4 are denoted with the same reference numerals, and description thereof is omitted as appropriate.
That is, the remote commander 121 of FIG. 18 is provided with a state management processing unit 131 in place of the state management processing unit 93, an infrared transmission / reception unit 132 in place of the infrared transmission unit 96, and a new signal pattern analysis processing unit 133. Except for being provided, the configuration is basically the same as that of the remote commander 1 described with reference to FIG.
The state management processing unit 131 manages the state of the input mode based on the operation analysis result by the operation analysis processing unit 92 and the signal supplied from the signal pattern analysis processing unit 133, and inputs the input to the operation analysis processing unit 92. Notify mode change. Similarly to the state management processing unit 93, the state management processing unit 131 notifies the LED control unit 94 of the occurrence of an error and associates it with the predetermined function when the user's operation input is not associated with the predetermined function. If so, the signal pattern generation processing unit 95 is supplied with information indicating to which function an operation input has been made. The infrared transmission / reception unit 132 not only transmits an infrared signal to the television receiver 122 but also receives an infrared signal transmitted from the television receiver 122 and supplies it to the signal pattern analysis processing unit 133. The signal pattern analysis processing unit 133 identifies whether or not the input of the free cursor is necessary based on the signal pattern received by the infrared transmission / reception unit 132, and the information indicating the result is the state management process. To the unit 131.
18 is provided with an infrared transmission / reception unit 141 in place of the infrared reception unit 101 and an operation control unit 142 in place of the operation control unit 103, and a new signal pattern generation processing unit 143. 4 is basically the same as that of the television receiver 2 described with reference to FIG.
The infrared transmission / reception unit 141 not only receives the infrared signal transmitted from the remote commander 121, but also transmits the infrared signal to the remote commander 121 based on the signal supplied from the signal pattern generation processing unit 143. The operation control unit 142 is based on information indicating a function corresponding to a user operation input, the GUI output control unit 104, the volume control processing unit 105, the input source control processing unit 106, the cursor movement control processing unit 107, and the power control process. Unit 108, channel control processing unit 109, and setting menu control processing unit 110, for example, when a bidirectional communication function or web browsing function is used, or when a BML browser in digital broadcasting is started In such a case, the signal pattern generation processing unit 143 is controlled to notify the remote commander 121 to receive an operation input in the free cursor mode when there is a high possibility of continuous input of the free cursor. When the state where there is a high possibility of continuous free cursor input is canceled, To notify the remote commander 121 to terminate Sorumodo, controls the signal pattern generation processing unit 143. The signal pattern generation processing unit 143 acquires an infrared signal pattern transmitted to the remote commander 121 based on the information supplied from the operation control unit 142, and supplies the infrared signal pattern to the infrared transmission / reception unit 141.
Next, the remote commander process 2 executed by the remote commander 121 described with reference to FIG. 18 will be described with reference to the flowchart of FIG.
In step S41 to step S49, basically the same processing as step S1 to step S9 described with reference to the flowchart of FIG. 16 is executed.
That is, when it is determined that the user's finger or the like has touched the track pad 11, coordinate information of the initial position where the user's finger or the like touched the track pad 11 is acquired, and the user's finger is obtained every predetermined period (100 msec). The coordinate information (region information) indicating the position where the touch pad touches the track pad 11 is acquired. When it is determined that the user's finger or the like has moved away from the track pad 11, the locus of the user's finger or the like is analyzed based on a list of coordinates (regions) on which the user's finger or the like has moved on the track pad 11. As described with reference to FIG. 6, the user command content associated with a locus such as the user's finger is extracted.
Then, the extracted command content of the user is transmitted to the television receiver 122, the state of the input mode is managed based on the extracted command content of the user, and the current input mode is changed as necessary. Based on the current input mode, the user's command content is transmitted to the television receiver 122.
In step S <b> 50, the state management processing unit 131 determines whether a notification of transition to the free cursor mode has been received from the television receiver 122 based on the signal supplied from the signal pattern analysis processing unit 133.
If it is determined in step S50 that a notification of transition to the free cursor mode has been received from the television receiver 122, in step S51, the state management processing unit 131 changes the input mode to the free cursor mode, and the input mode is changed. The operation analysis processing unit 92 is notified of the free cursor mode, and the process returns to step S49, and the subsequent processes are repeated.
If it is determined in step S50 that the notification of transition to the free cursor mode has not been received from the television receiver 122, the state management processing unit 131 is supplied from the operation analysis processing unit 92 in step S52. Based on the content of the command corresponding to the operation input or when the input mode is the free cursor mode based on the notification from the television receiver 122, the input is based on the signal supplied from the signal pattern analysis processing unit 133. Determine whether the mode has ended. If it is determined in step S52 that the input mode has not ended, the process returns to step S49, and the subsequent processes are repeated in the same input mode. If it is determined in step S52 that the input mode has been completed, the state returns to the “first stage input standby state” again, so that the process returns to step S41 and the subsequent processing is repeated.
The processing in each input mode is the same as that described with reference to FIG. 17 using the change amount input mode as an example, and thus detailed description thereof is omitted here.
Through such processing, the user using the remote commander 121 uses the trackpad 11 that is only one input device to select a function, to input a value for the function, and a free cursor. In addition, when the television receiver 122 uses a bidirectional communication function or a web browsing function, or when a BML browser for digital broadcasting is activated, a free cursor is displayed. When there is a high possibility of continuous input, a signal indicating that there is a high possibility of continuous input of a free cursor is received from the television receiver 122 and automatically The state can be changed to the cursor mode.
In the above-described embodiment, the GUI screen for assisting the user's operation input is described as being displayed on the display unit 22 of the television receiver. However, the television receiver displays the GUI screen. If there is no display function, or the device operated by the remote commander is a device that does not have sufficient display functions, such as a stereo or air conditioner, a liquid crystal display unit is provided on the remote commander. A GUI screen for assisting the user's operation input may be displayed on the remote commander.
FIG. 20 is an external configuration diagram of the remote commander 161 capable of displaying a GUI screen for assisting the user's operation input. The remote commander 161 in FIG. 20 has the same external configuration as the remote commander 1 described with reference to FIG. 1 except that a liquid crystal display unit 171 is newly added. In the remote commander 161 of FIG. 20, the error display LED 13 may be omitted by displaying error information on the liquid crystal display unit 171.
FIG. 21 shows functions of a remote commander 161 that can display a GUI screen for assisting a user's operation input, and a television receiver 181 that does not display a GUI screen for assisting a user's operation input ( It is a functional block diagram for demonstrating only the part corresponding to the process with respect to a user's operation input.
That is, the remote commander 161 of FIG. 21 basically has the same configuration as that of FIG. 4 except that a state management processing unit 191 is provided instead of the state management processing unit 93 and a GUI output control unit 192 is newly provided. This is configured in the same manner as the remote commander 1 described above.
The state management processing unit 191 manages the state of the input mode based on the operation analysis result by the operation analysis processing unit 92 and notifies the operation analysis processing unit 92 of the change of the input mode, as well as FIGS. In order to display on the liquid crystal display unit 171 a GUI screen for assisting the user's operation input corresponding to the function called by the user as described with reference to FIGS. The unit 192 is controlled. Similarly to the state management processing unit 93, the state management processing unit 191 notifies the LED control unit 94 of the occurrence of an error and associates it with the predetermined function when the user operation input is not associated with the predetermined function. If so, the signal pattern generation processing unit 95 is supplied with information indicating to which function an operation input has been made. The GUI output control unit 192 corresponds to the function called by the user as described with reference to FIGS. 7 to 11 and FIGS. 13 and 14 based on the control of the state management processing unit 191. Controls the display on the liquid crystal display unit 171 of the GUI screen for assisting the user's operation input.
Further, the television receiver 181 of FIG. 21 basically uses FIG. 4 except that the operation control unit 201 is provided in place of the operation control unit 103 and the GUI output control unit 104 is omitted. This has the same configuration as the television receiver 2 described.
Based on information indicating a function corresponding to a user operation input, the operation control unit 201 is a volume control processing unit 105, an input source control processing unit 106, a cursor movement control processing unit 107, a power control processing unit 108, and a channel control process. Unit 109 and setting menu control processing unit 110 are controlled.
Next, the remote commander processing 3 executed by the remote commander 161 described with reference to FIGS. 20 and 21 will be described with reference to the flowchart of FIG.
In steps S71 to S76, basically the same processing as that in steps S1 to S6 described with reference to the flowchart of FIG. 16 is executed.
In step S77, the state management processing unit 191 assists the user's operation input in accordance with the function called by the user as described with reference to FIGS. 7 to 11 and FIGS. The GUI output control unit 192 is controlled in order to display the GUI screen for displaying on the liquid crystal display unit 171. The GUI output control unit 192 displays, on the liquid crystal display unit 171, a GUI screen for assisting the user's operation input corresponding to the function called by the user based on the control of the state management processing unit 191. Control.
In steps S78 and S79, basically the same processing as that in steps S7 and S8 described with reference to the flowchart of FIG. 16 is executed.
That is, the extracted user command content is transmitted to the television receiver 122, the input mode state is managed based on the extracted user command content, and the current input mode is changed as necessary. The
In step S80, the state management processing unit 191 determines the user based on the list of coordinates (area) in which the user's finger or the like has moved on the trackpad 11 and the notified input mode, which are supplied from the operation input acquisition unit 91. The operation input is acquired and supplied to the state management processing unit 93. The state management processing unit 93 controls the GUI output control unit 192 in order to update the display of the GUI screen based on the user's operation input, and manages the state of the input mode, and if necessary, the signal pattern Through the processing of the generation processing unit 95 and the infrared transmission unit 96, the user's command content is transmitted to the television receiver 2.
In step S <b> 81, the state management processing unit 191 determines whether or not the input mode has ended based on the command content corresponding to the user's operation input supplied from the operation analysis processing unit 92. If it is determined in step S81 that the input mode has not ended, the process returns to step S80, and the subsequent processes are repeated in the same input mode. If it is determined in step S81 that the input mode has ended, the state returns to the “first stage input standby state” again, so that the process returns to step S71 and the subsequent processing is repeated.
Through such processing, even when a user using the remote commander 161 performs an operation input to a device that does not have a GUI screen display function, the user can use the trackpad 11 as a single input device to perform the function. An operation to select, an operation to input a value for the function, and an operation to move the free cursor can be input.
As described above, the user can perform operation input using a remote commander having unified operability in channel designation, volume change, input source switching, selection of a setting menu, and movement of a free cursor. In particular, when the present invention is applied, since the operation is simple, the user can perform the operation input without looking at the input device (the user's hand) of the remote commander. In addition, the remote commander to which the present invention is applied is excellent in durability because there are no movable parts such as buttons, shuttle buttons, trackballs, etc. used in conventional remote commanders.
In the above description, the shape of the track pad 11 of the remote commander is circular, but the shape of the track pad 11 may be other shapes. For example, the track pad 11 of the remote commander may be a quadrangle or donut shape, or may be operated using the entire palm in a dome-like shape rather than planar.
Further, in the present embodiment, the case where the television receiver is operated using the remote commander is described, but the device that is the operation target of the user is, for example, a video deck, a stereo, an air conditioner, etc. The present invention is applicable to any existing device that is steered by a remote commander.
The series of processes described above can also be executed by software. The software is a computer in which a program constituting the software is incorporated in dedicated hardware, or a various personal computer capable of executing various functions by installing various programs. For example, it is installed from a recording medium.
As shown in FIG. 3, this recording medium is distributed to provide a program to a user separately from a computer, and includes a magnetic disk 71 (including a flexible disk) on which a program is recorded, an optical disk 72 (CD- Consists of a package medium composed of ROM (Compact Disk-Read Only Memory), DVD (Digital Versatile Disk), magneto-optical disk 73 (including MD (Mini-Disk) (trademark)), or semiconductor memory 74 Is done.
It is a figure which shows the external appearance structure of the remote commander and television receiver to which this invention is applied. It is a hardware block diagram of a remote commander. It is a hardware block diagram of a television receiver. It is a functional block diagram of a remote commander and a television receiver. It is a figure for demonstrating area division of a trackpad. It is a figure for demonstrating the figure drawn on a trackpad. It is a figure for demonstrating a GUI screen. It is a figure for demonstrating a GUI screen. It is a figure for demonstrating a GUI screen. It is a figure for demonstrating a GUI screen. It is a figure for demonstrating a GUI screen. It is a state transition diagram which shows the transition of the input mode of a remote commander. It is a figure for demonstrating a GUI screen. It is a figure for demonstrating a GUI screen. It is a state transition diagram which shows the transition of the input mode of a remote commander. It is a flowchart for demonstrating the process 1 of a remote commander. It is a flowchart for demonstrating the process of the variation input mode of a remote commander. It is a functional block diagram by a different structure of a remote commander and a television receiver. It is a flowchart for demonstrating the process 2 of a remote commander. It is a figure which shows the other example of an external appearance structure of a remote commander. It is a functional block diagram by a different structure of a remote commander and a television receiver. It is a flowchart for demonstrating the process 3 of a remote commander.
DESCRIPTION OF SYMBOLS 1 Remote commander, 2 Television receiver, 311 Track pad, 12 Infrared transmission part, 21 Infrared receiving part, 22 Display part, 41 CPU, 61 CPU, 91 Operation input acquisition part, 92 Operation analysis process part, 93 State management process Unit, 95 signal pattern generation processing unit, 96 infrared transmission unit, 101 infrared reception unit, 102 signal pattern analysis processing unit, 103 operation control unit, 104 GUI processing unit, 121 remote commander, 122 television receiver, 131 state management processing Unit, 132 infrared transmission / reception unit, 133 signal pattern analysis processing unit, 141 infrared transmission / reception unit, 142 operation control unit, 143 signal pattern generation processing unit, 161 remote commander, 171 liquid crystal display unit, 181 television receiver, 191 state management processing unit, 192 GUI processing unit, 201 operation control unit
In an information processing system composed of an information input device and an information processing device,
Operation input means for receiving user operation input;
Input mode control means for controlling the input mode based on the user's operation input input by the operation input means;
First transmission means for transmitting information on the input mode controlled by the input mode control means to the information processing apparatus,
The operation input means has a graphic drawing area having a predetermined surface area,
The input mode control means controls the input mode based on the shape of a graphic drawn by the user in the graphic drawing area of the operation input means,
First receiving means for receiving information transmitted by the first transmitting means of the information input device;
An operation control unit that controls an operation that can be performed by the information processing device based on the information received by the first receiving unit;
Display means for displaying predetermined information according to the control by the operation control means,
The information processing system, wherein the display unit displays information for assisting an operation input to the operation input unit of the information input device by the user according to the input mode.
The information processing apparatus further includes second transmission means for transmitting information on the input mode to the information input apparatus,
The information input device further includes second receiving means for receiving information on the input mode transmitted by the second transmitting means of the information processing apparatus,
The operation control means of the information processing apparatus causes the information input apparatus to transmit information for designating the input mode to the information input apparatus based on an operation being performed by the information processing apparatus.
The input mode control means of the information input device further controls the input mode based on information for designating the input mode received by the second receiving means. Information processing system described in 1.
The operation control means of the information processing apparatus is configured such that the user is referring to the predetermined information displayed by the display means when the operation being executed is moved by the user using the information input device. When in the commanded state, the second transmission means transmits information for setting the input mode to an input mode for receiving an operation input corresponding to the movement of the cursor, to the information input device. The information processing system according to claim 2.
The information for assisting the operation input by the user displayed on the display unit of the information input device is displayed in a shape corresponding to the shape of the operation input unit of the information input device. The information processing system according to claim 1.
The information processing system according to claim 1, wherein the operation input unit of the information input device has a circular shape.
An information input device having a predetermined graphic depiction area and provided with an operation input unit for receiving a user's operation input;
An information processing method for an information processing system including an information processing device provided with a display unit capable of displaying predetermined information,
In the information input device, a first operation input acquisition step of acquiring the first operation input of the user input by the operation input unit;
In the information input device, based on the first operation input of the user acquired by the processing of the first operation input acquisition step, a shape analysis step of analyzing the shape of the graphic drawn in the graphic drawing area When,
In the information input device, based on the shape of the graphic analyzed by the processing of the shape analysis step, an extraction step for extracting the command content of the user;
In the information input device, a first transmission step of transmitting information corresponding to the user's instruction content extracted by the extraction step processing to the information processing device;
In the information input device, an input mode control step for controlling an input mode based on the command content of the user extracted by the processing of the extraction step;
In the information processing apparatus, a reception step of receiving information corresponding to the user instruction content transmitted by the processing of the first transmission step;
In the information processing apparatus, a display control step for controlling display of predetermined information on the display unit based on the user instruction content received by the processing of the reception step;
In the information input device, based on the input mode controlled by the processing of the input mode control step, the second operation input of the user referring to the display unit input by the operation input unit is acquired. A second operation input acquisition step,
And a second transmission step of transmitting information corresponding to the second operation input of the user acquired by the processing of the second operation input acquisition step to the information processing apparatus. Method.
Using an operation input unit having a predetermined graphic drawing area, a user's operation input to an information processing apparatus provided with a display unit capable of displaying predetermined information is received, and the information processing apparatus receives the user's operation input. A program for causing a computer to execute processing for transmitting corresponding information,
A first operation input acquisition step of acquiring the first operation input of the user input by the operation input unit;
A shape analysis step of analyzing the shape of the graphic depicted in the graphic depiction region based on the first operation input of the user acquired by the processing of the first operation input acquisition step;
Based on the shape of the figure analyzed by the processing of the shape analysis step, an extraction step for extracting the user's command content;
A first transmission control step for controlling transmission to the information processing apparatus of information corresponding to the user's instruction content extracted by the extraction step;
An input mode control step for controlling the input mode based on the user's instruction content extracted by the extraction step;
The information for assisting the operation input displayed on the display unit of the information processing apparatus that has received the information corresponding to the command content of the user whose transmission is controlled by the processing of the first transmission control step is referred to A second operation input acquisition step of acquiring, by the user, a second operation input input by the operation input unit based on the input mode controlled by the process of the input mode control step;
A second transmission control step for controlling transmission of information corresponding to the second operation input of the user acquired by the processing of the second operation input acquisition step to the information processing apparatus. A program for causing a computer to execute the process.
In an information input device in which a user performs an operation input for controlling a predetermined device,
An operation input means for receiving an operation input of the user;
Display means for displaying first information according to the input mode controlled by the input mode control means;
Transmission means for transmitting, to the predetermined device, second information related to an operation input for the user to control the predetermined device;
The first information displayed by the display means is information for assisting an operation input to the operation input means of the information input device by the user corresponding to the input mode,
The second information transmitted by the transmission means is information related to an operation input performed by the user referring to the first information displayed by the display means.
The information input device according to claim 8, wherein information for assisting an operation input by the user displayed on the display unit is displayed in a shape corresponding to a shape of the operation input unit.
The information input device according to claim 9, wherein the operation input unit has a circular shape.
An operation input unit having a predetermined graphic description area and receiving an operation input by a user;
An information processing method for an information input device comprising a display unit capable of displaying predetermined information,
A shape analysis step of analyzing a shape of a graphic depicted in the graphic depiction region based on the first operation input of the user acquired by the processing of the first operation input acquisition step;
A display control step for controlling display of predetermined information on the display unit based on the user's instruction content extracted by the extraction step;
A first transmission step of transmitting information corresponding to the user instruction content extracted by the processing of the extraction step to another device;
A second operation input acquisition step of acquiring a second operation input of the user input by the operation input unit based on the input mode controlled by the process of the input mode control step;
And a second transmission step of transmitting information corresponding to the second operation input of the user acquired by the processing of the second operation input acquisition step to another device. .
And a display unit capable of displaying predetermined information. The computer receives a user operation input to another information processing apparatus and causes the information processing apparatus to transmit information corresponding to the user operation input to the computer. A program for
A first transmission control step for controlling transmission to the information processing apparatus of information corresponding to the user instruction content extracted by the extraction step;
A second transmission step of controlling transmission of information corresponding to the second operation input of the user acquired by the processing of the second operation input acquisition step to the information processing apparatus. A program for causing a computer to execute the process.
JP2004164588A 2004-06-02 2004-06-02 Information processing system, information input device, information processing method and program Withdrawn JP2005348036A (en)
JP2004164588A JP2005348036A (en) 2004-06-02 2004-06-02 Information processing system, information input device, information processing method and program
JP2005348036A true JP2005348036A (en) 2005-12-15
ID=35500007
JP2004164588A Withdrawn JP2005348036A (en) 2004-06-02 2004-06-02 Information processing system, information input device, information processing method and program
JP (1) JP2005348036A (en)
JP2008052585A (en) * 2006-08-25 2008-03-06 Kyocera Corp Portable electronic device and its control method
JP2008052582A (en) * 2006-08-25 2008-03-06 Kyocera Corp Portable electronic equipment and control method thereof
JP2008090680A (en) * 2006-10-03 2008-04-17 Nec Saitama Ltd Portable terminal device, and function activation method for portable terminal device
JP2010503919A (en) * 2006-09-13 2010-02-04 サバント システムズ エルエルシー Programmable multimedia controller remote control unit
WO2011034097A1 (en) * 2009-09-17 2011-03-24 日本電気株式会社 Electronic apparatus using touch panel and setting value modification method of same
JP2011082712A (en) * 2009-10-05 2011-04-21 Toshiba Corp Remote control apparatus
JP2011166794A (en) * 2011-03-03 2011-08-25 Toshiba Corp Remote controller
JP2013503386A (en) * 2009-08-31 2013-01-31 クアルコム，インコーポレイテッド User interface method providing search function
JP2013132061A (en) * 2013-01-25 2013-07-04 Toshiba Corp Receiver and operation control method of the same
JP2013140597A (en) * 2012-01-05 2013-07-18 Visteon Global Technologies Inc Projection dynamic icon knobs
CN103809873A (en) * 2012-11-13 2014-05-21 联想(北京)有限公司 Information processing method and input device
JP2014532949A (en) * 2011-11-08 2014-12-08 マイクロソフト コーポレーション Indirect user interface interaction
JP2016534440A (en) * 2013-07-31 2016-11-04 オラクル・インターナショナル・コーポレイション User interface for tracking health behavior
JP2017157245A (en) * 2017-06-16 2017-09-07 株式会社三菱東京Ｕｆｊ銀行 Information processing unit and program
2004-06-02 JP JP2004164588A patent/JP2005348036A/en not_active Withdrawn
JP4721986B2 (en) * 2006-08-25 2011-07-13 京セラ株式会社 Portable electronic device and method for controlling portable electronic device
JP2016015148A (en) * 2010-08-06 2016-01-28 三星電子株式会社Ｓａｍｓｕｎｇ Ｅｌｅｃｔｒｏｎｉｃｓ Ｃｏ．，Ｌｔｄ． Display apparatus and control method thereof
CN103809873B (en) * 2012-11-13 2018-02-27 联想(北京)有限公司 A kind of information processing method and input equipment
US20160231829A1 (en) 2016-08-11 Network control system, control apparatus, controlled apparatus, and apparatus control method
KR101518280B1 (en) 2015-05-08 Display apparatus and method for displaying
JP4346892B2 (en) 2009-10-21 Electronic program guide display control apparatus, electronic program guide display control method, and electronic program guide display control program
KR20140071157A (en) 2014-06-11 Information Outputting Method And Electronic Device Supporting the same
KR101590341B1 (en) 2016-02-19 Method and apparatus controlling interrupt in portable terminal
JP4812841B2 (en) 2011-11-09 Video playback device for AV equipment
KR102006740B1 (en) 2019-08-02 Method and apparatus for displaying screen in mobile terminal
US20110113374A1 (en) 2011-05-12 Graphical User Interface User Customization