Remote control system, television set and remote controller using manipulation signals

A remote control system of the present invention is provided with a TV apparatus and a remote controller, and performs two-way communication. The remote controller is provided with a microphone and a speaker, and generates and outputs sound source data. Furthermore, by the use of wireless communication modules, the sound source data produced by the remote controller is transmitted to the TV apparatus, and the sound source data is transmitted from the TV apparatus to the remote controller, that is, the sound source data is exchanged, with the result that the sound source data is outputted from the TV apparatus and the remote controller.

TECHNICAL FIELD

The present invention relates to a remote control system that employs a remote controller for use in an electronic appliance such as a television set, and also relates to a television set and a remote controller that utilize such a remote control system.

BACKGROUND ART

Nowadays, remote controllers are widely used to allow remote manipulation of audio-visual appliances such as television sets and VCRs, DVD players and audio sets, air conditioners and other electronic appliances. However, as electronic appliances become provided with an increasingly large number of functions, remote controllers become provided with more and more buttons and the like that permit various manipulations; thus unfamiliar users can only use part of such a large number of functions. Under this circumstance, in order to facilitate manipulation of remote controllers of electronic appliances, there have been proposed, for example, remote controllers that provide manipulation instructions in the form of audio (see patent documents 1 and 2).

As such a multifunctional remote controller, there has been proposed, for example, a remote controller, for use with a television set which can display a sub window, that can output the audio of a program displayed in the sub window (see patent document 3).

As such multi-functional remote controllers, there have also been proposed, for example, a remote controller that indicates its location by producing sound and a remote control system provided with a microphone (see patent documents 2 and 4).Patent document 1: JP-A-H10-243476Patent document 2: JP-A-2002-247670Patent document 3: JP-A-2003-032573Patent document 4: JP-A-H08-294184

DISCLOSURE OF THE INVENTION

Problems to be Solved by the Invention

Disadvantageously, however, in order to provide the above-mentioned audio instructions, it is necessary to store a large amount of sound source data. To reduce the amount of data stored, it is necessary either to lower audio quality or to reduce the contents of the audio instructions. It is possible that a user receiving audio instructions alone fails to understand how to perform the manipulation.

If the audio of a program is outputted from a remote controller as described above, this results in the complicated configuration of the remote controller.

If the above-mentioned multi functionality shortens the life of batteries, such a remote controller is not user-friendly.

If a remote controller is configured to allow input and output of audio as mentioned above, it is inevitable that its configuration becomes complicated and its size is increased. Simply allowing input and output of audio limits the use of the remote controller despite its being configured to allow input and output.

In view of the foregoing, it is an object of the present invention to provide a remote control system, a television set and a remote controller that are more user-friendly. It is another object of the invention to provide a remote control system and a television set of simple configuration that can output the audio of a program. It is yet another object of the invention to provide a remote controller and a television set that can achieve multi functionality and that are more user-friendly.

Means for Solving the Problem

To achieve the above objects, according to one aspect of the present invention, there is provided a remote control system including: a television set that receives a television manipulation signal corresponding to a manipulation display on a television screen and that transmits encoded sound source data related to the manipulation signal; and a remote controller that transmits the manipulation signal to the television set and that decodes the sound source data received from the television set and outputs the decoded sound source data in the form of audio.

In the remote control system configured as described above, the television set may transmit sound source data on the following manipulation to the remote controller by reception of the manipulation signal.

In the remote control system configured as described above, when the following manipulation is not performed within a predetermined period after reception of the manipulation signal, the television set may transmit to the remote controller sound source data for prompting a user to perform the following manipulation.

In the remote control system configured as described above, the remote controller may receive sound source data on the following manipulation from the television set by transmission of the manipulation signal.

In the remote control system configured as described above, when the following manipulation is not performed within a predetermined period after transmission of the manipulation signal, the remote controller may receive, from the television set, sound source data for prompting a user to perform the following manipulation.

In the remote control system configured as described above, the television set may change the manipulation display on the television screen by reception of the manipulation signal.

In the remote control system configured as described above, the television set may move a display on the television screen by reception of the manipulation signal.

In the remote control system configured as described above, the television set can display a main screen and a sub screen on the television screen, and the display moved on the television screen may be the sub screen within the main screen.

In the remote control system configured as described above, the display moved on the television screen may be a pointer indicating a manipulation position within the television screen.

In the remote control system configured as described above, the sound source data transmitted from the television set may be ADPCM-encoded, and the remote controller may have an ADPCM decoder.

In the remote control system configured as described above, the remote controller may have a three-dimensional force sensor for generating the manipulation signal.

In the remote control system configured as described above, the remote controller may have a touch panel sensor for generating the manipulation signal.

In the remote control system configured as described above, the remote controller may receive and decode sound source data that is not based on a manipulation on the remote controller and that is transmitted from the television set and output the decoded sound source data in the form of audio.

In the remote control system configured as described above, the remote controller may receive and decode sound source data stored in the television set by transmission from the remote controller and output the decoded sound source data in the form of audio.

According to another aspect of the present invention, there is provided a television set including: a television screen; a transmit/receive portion; a manipulation control portion controlling the television set based on a display on the television screen and a manipulation signal received by the transmit/receive portion; a sound source data storing portion storing encoded sound source data; and a transmission control portion that selects, from the sound source data storing portion, sound source data related to the manipulation signal and that transmits the sound source data through the transmit/receive portion.

In the television set configured as described above, the transmission control portion may transmit sound source data on the following manipulation requested by the manipulation control portion.

In the television set configured as described above, the sound source data storing portion may store ADPCM-encoded sound source data.

According to another aspect of the present invention, there is provided a remote controller including: a manipulation portion; a transmit/receive portion; a transmission control portion transmitting, through the transmit/receive portion, a manipulation signal based on a manipulation on the manipulation portion; a decoder decoding sound source data received in relation to transmission of the manipulation signal; and an output portion outputting the sound source data decoded by the decoder in the form of audio.

In the remote controller configured as described above, the manipulation portion may have a three-dimensional force sensor for generating the manipulation signal.

In the remote controller configured as described above, the manipulation portion may have a touch panel sensor for generating the manipulation signal.

In the remote controller configured as described above, the decoder may have an ADPCM decoder.

The remote controller configured as described above may further include a vibration generation portion operating when decoding is performed by the decoder to produce audio.

According to another aspect of the present invention, there is provided a remote control system including: a television set transmitting sound source data obtained by encoding audio of a program displayed on a television screen; and a remote controller that decodes the sound source data received from the television set and that outputs the decoded sound source data in the form of audio.

In the remote control system configured as described above, the television set may reduce, when transmitting the sound source data to the remote controller, audio output from the television set itself.

In the remote control system configured as described above, the television set can display a main screen and a sub screen on a television screen, and the television set itself may output audio of a program displayed on one of the main and sub screens and the sound source data of audio of a program displayed on the other of the main and sub screens may be transmitted to the remote controller.

In the remote control system configured as described above, the television set may delay, when transmitting the sound source data to the remote controller, an image output on the television screen in synchronization with audio output from the remote controller.

In the remote control system configured as described above, the sound source data transmitted from the television set may be ADPCM-encoded, and the remote controller may have an ADPCM decoder.

According to another aspect of the present invention, there is provided a television set including: a television screen; a speaker; a control portion outputting a television program through the television screen and the speaker; and a wireless transmission portion transmitting sound source data obtained by encoding audio of the television program. In the television set, when the sound source data obtained by the encoding is transmitted from the wireless transmission portion, no audio is outputted from the speaker so that output of audio obtained by decoding the sound source data is prevented from being displaced in time from output of audio from the speaker.

According to another aspect of the present invention, there is provided a television set including: a television screen; a speaker; a wireless transmission portion; a display control portion displaying a main screen and a sub screen on the television screen; and an audio control portion that outputs audio of a program displayed on one of the main and sub screens and that transmits, from the wireless transmission portion, sound source data obtained by encoding audio of a program displayed on the other of the main and sub screens.

The television set configured as described above may further include image delaying means for delaying, when sound source data is transmitted from the wireless transmission portion, an image output on the television screen such that audio obtained by decoding the sound source data and outputted is synchronized with a corresponding image on the television screen.

The television set configured as described above may include: a television screen; a speaker; a control portion outputting a television program through the television screen and the speaker; a wireless transmission portion transmitting sound source data obtained by encoding audio of the television program; and image delaying means for delaying, when the sound source data obtained by the encoding is transmitted from the wireless transmission portion, an image output on the television screen such that audio obtained by decoding the sound source data is synchronized with an image on the television screen.

In the television set configured as described above, the sound source data transmitted from the television set may be ADPCM-encoded.

According to another aspect of the present invention, there is provided a remote control system including: a television set that can receive a television manipulation signal corresponding to a manipulation display on a television screen, that can transmit encoded sound source data related to the manipulation signal and that can transmit sound source data obtained by encoding audio of a program displayed on the television screen; and a remote controller that transmits the manipulation signal to the television set and that decodes the sound source data received from the television set and outputs the decoded sound source data in the form of audio.

According to another aspect of the present invention, there is provided a remote control system including: a manipulation portion; a transmission portion transmitting a manipulation signal; an output portion outputting sound source data on a manipulation in the form of audio; a power supply portion switching between an activated state and a sleep state; and a control portion preventing, even if the transmission of the manipulation signal is completed, the power supply portion from switching from the activated state to the sleep state until the output of the audio from the output portion is completed.

According to another aspect of the present invention, there is provided a remote controller including: a manipulation portion; a transmission portion transmitting a manipulation signal; an output portion outputting sound source data on a manipulation in the form of audio; a power supply portion switching between an activated state and a sleep state; and a control portion controlling the switching of the power supply portion between the activated state and the sleep state such that the power supply portion switches to a different state according to whether the output portion is operated.

In the remote controller configured as described above, the control portion may include control means performing the switching of the power supply portion from the activated state to the sleep state a predetermined period after the transmission of the transmission portion is completed and control means performing the switching of the power supply portion from the activated state to the sleep state based on completion of the output of the audio from the output portion.

In the remote controller configured as described above, the sound source data may be ADPCM-encoded.

The remote controller configured as described above may further include a reception portion receiving the sound source data.

According to another aspect of the present invention, there is provided a remote controller including: a manipulation portion; a transmission portion transmitting a manipulation signal; an output portion outputting sound source data on a manipulation in the form of audio; and a volume control portion controlling the volume of audio outputted from the output portion.

The remote controller configured as described above may further include a reception portion receiving sound source data for use in volume control.

The remote controller configured as described above may further include a transmission portion transmitting a signal for preventing audio from being outputted externally while the audio is outputted, the volume of which is controlled by the volume control portion.

According to another aspect of the present invention, there is provided a television set including: a television screen; a speaker; a control portion outputting a television program through the television screen and the speaker; a wireless transmission portion transmitting encoded sound source data for testing; and an administration portion preventing audio from being outputted from the speaker when the encoded sound source data is transmitted from the wireless transmission portion.

According to another aspect of the present invention, there is provided a remote controller including: a manipulation portion; a transmission portion transmitting a manipulation signal; a reception portion receiving sound source data that is not based on a manipulation on the manipulation portion; and an output portion outputting the received sound source data in the form of audio. In the remote controller, the remote controller can be bcated by transmission of the sound source data.

In the remote controller configured as described above, sound source data based on a manipulation on the manipulation portion and received by the reception portion may be outputted from the output portion such that information related to the manipulation on the manipulation portion is obtained in the form of audio.

In the remote controller configured as described above, the volume of the output portion can be variably set, and, when the sound source data that is not based on a manipulation on the manipulation portion is received, a maximum volume output is produced irrespective of the setting of the volume.

In the remote controller configured as described above, the volume of the output portion may be set differently for the sound source data that is based on a manipulation on the manipulation portion and the sound source data that is not based on a manipulation on the manipulation portion.

In the remote controller configured as described above, the remote controller can be started up either by a manipulation on the manipulation portion or by the reception of the sound source data by the reception portion.

In the remote controller configured as described above, the sound source data may be ADPCM-encoded.

According to another aspect of the present invention, there is provided a remote controller including: a main body that is manipulated by a manipulation signal and that has a memorizing portion memorizing sound source data; and a remote controller that transmits sound source data of acquired audio to the main body and that receives the transmitted sound source data and then outputs the transmitted sound source data in the form of audio.

According to another aspect of the present invention, there is provided a remote controller including: audio acquisition means; a transmission portion transmitting sound source data of acquired audio; a reception portion receiving the transmitted sound source data; and an output portion outputting the received sound source data in the form of audio.

In the remote controller configured as described above, the sound source data may be ADPCM-encoded.

Advantages of the Invention

According to the present invention, since encoded sound source data is transmitted from a television set to a remote controller, the amount of data transmitted can be reduced. Moreover, audio instructions and manipulation instructions displayed on a television screen help a user understand how to perform manipulations and help simplify the configuration of components for manipulations in the remote controller. Thus, it is possible to reduce the size of a high-performance remote controller.

According to the invention, an image displayed on a television screen is delayed, and this prevents an audio output from a remote controller from being displaced as a result of an encoded signal being transmitted. Thus, the user can view a program without feeling uncomfortable even if audio is outputted from the remote controller.

According to the invention, a high-performance and high-power consuming remote controller can be brought to a sleep state when not in use, and this reduces the frequency with which a battery is replaced. Moreover, even if a time is reached when power needs to be turned off, the power remains on until the audio announcement is completed. Thus, it is possible to make the contents of the audio announcement understood.

According to the invention, since the television set records sound source data, it is unnecessary for the remote controller to record the sound source data. This makes it possible to reduce the size of the remote controller. Thus, the transmission of the sound source data to the remote controller allows the remote controller to receive the sound source data and perform an audio output. This helps simplify the configuration of the remote controller and helps locate it.

LIST OF REFERENCE SYMBOLS

104Display Control Portion

114Audio Data Memory

115Wireless Communication Module

202Wireless Communication Module

206Power Supply Portion

214Audio Data Memory

Best Mode for Carrying Out the Invention

A remote control system according to an embodiment of the present invention will be described below with reference to the accompanying drawings. In this embodiment, a remote control system in a television apparatus (hereinafter referred to simply as a “TV apparatus”) that receives and reproduces a television broadcast will be described as an example.

The configuration of the remote control system according to the embodiment of the present invention will now be described with reference to the drawings.FIG. 1is a block diagram showing the internal configuration of individual devices in the remote control system of this embodiment and the relationship therebetween.

In the remote control system shown inFIG. 1, there are provided a TV apparatus1that receives and reproduces a television broadcast such as a terrestrial broadcast or a satellite broadcast and a remote controller2that performs wireless communication with the TV apparatus1to manipulate it. Between the TV apparatus1and the remote controller2, two-way communication is performed by wireless communication based on, for example, a wireless LAN method conforming to the IEEE802.11 standard including WiFi (trademark) or a Bluetooth (trademark) method.

The configuration and operation of the TV apparatus1in the remote control system configured as described above will be outlined below. As shown inFIG. 1, the TV apparatus1is provided with: a broadcast reception interface (I/F)101that receives television broadcasts through an antenna, a cable or the like; a tuner102that selects from the television broadcasts received through the broadcast reception I/F101; a decoder103that decodes a broadcast signal obtained as a result of a television broadcast being selected by the tuner102; a display control portion104that performs image processing to reproduce and display, on a display105, a video signal obtained through decoding by the decoder103; the display105that reproduces and displays video; an image memorizing portion106that records graphic images and text images (OSD (on-screen display) images) used in, for example, manipulation screens called up by the remote controller2; a frame memory107in which the video signal obtained through decoding by the decoder103is temporarily memorized; a DAC (digital-to-analog converter)108that converts an audio signal obtained through decoding by the decoder103into an analog signal; an amplifier109that amplifies the audio signal obtained by the DAC108; and a speaker110that reproduces and outputs audio corresponding to the audio signal amplified by the amplifier109.

The TV apparatus1is further provided with: a CPU111that controls the entire apparatus; a memory112in which programs for performing individual operations are memorized; an audio encoder113that converts the audio signal obtained by the decoder103into a highly reproducible digital signal having a reduced amount of data, by an encoding method such as an ADPCM (adaptive differential pulse code modulation) method; an audio data memory114in which audio data is memorized that includes sound source data encoded by the same encoding method as used in the audio encoder113; a wireless communication module115that performs wireless communication with the remote controller2; a HDD (hard disk drive)116that records, as a moving picture content file, a broadcast signal obtained as a result of a television broadcast being selected by the tuner103; and a manipulation portion117through which a user manipulates the TV apparatus1.

In the TV apparatus1configured as described above, when a digital television broadcast is received, broadcast signals that are in the form of high-frequency signals (RF signals) and are received through the broadcast reception I/F101are fed to the tuner102. In the tuner102, the broadcast of a desired channel is selected, is then converted into an intermediate-frequency signal (IF signal) and is then demodulated based on a digital modulation method, with the result that the broadcast signal of the desired channel is acquired. Here, in the case of, for example, a terrestrial digital broadcast employing an OFDM (orthogonal frequency division multiplex) method, in the tuner102, a plurality of multiplexed carrier signals are first acquired from the IF signal obtained as a result of a broadcast being selected, and then those carrier signals are demodulated by digital modulation methods such as QPSK (quadrature phase shift keying) and QAM (quadrature amplitude modulation), each assigned to those individual carrier signals. In this way, it is possible to obtain a broadcast signal in the form of a digital signal.

When the broadcast signal thus obtained is fed to the decoder103, in the decoder103, the broadcast signal is decoded by an encoding method such as an MPEG compression encoding method, and thus a video signal and an audio signal are obtained. Then, when the video signal is fed to the display control portion104, it is first subjected to image processing such as scaling and is then fed to the display105, where the video of the received television broadcast is reproduced and outputted. When the audio signal obtained by the decoder103is fed to the DAC108and is converted into an audio signal in the form of an analog signal, audio corresponding to the audio signal is reproduced and outputted from the speaker110.

In the TV apparatus1reproducing and outputting a television broadcast as described above, the tuner102is so configured as to select the television broadcasts of a plurality of channels. Specifically, in order to receive, when a plurality of screens are displayed on the display105, broadcast signals corresponding to the number of the screens, the tuner102is configured to include as many tuner circuits for selecting a plurality of channels as there are channels selected. When a plurality of video signals are obtained as a result of the selected broadcast signals being decoded by the decoder103, these video signals are combined by the display control portion104. This results in a plurality of screens being displayed on the display105.

Thus, in a case where, when video is displayed on the display105, a main screen is combined with one sub screen, two tuner circuits select broadcast signals to be reproduced in the main and the sub screens, respectively. Then, when the two broadcast signals obtained as a result of the broadcasts being selected are fed to the decoder103, they are decoded by the decoder103, and thus video signals corresponding to the main and the sub screens, respectively, are obtained. The video signals based on these two broadcast signals are fed to the display control portion104, where the video signal for the sub screen is subjected to image processing such as reduction processing and is thereby reduced. Then, the video signal for the sub screen is combined with the video signal for the main screen.

When an OSD display other than such a display of a plurality of screens is requested, the display control portion104reads an OSD image memorized in the image memorizing portion106and performs image combination to display the OSD image on the display105. Here, in a case where the OSD image is combined with video corresponding to a video signal from the decoder103or the frame memory107, in the display control portion104, image processing is performed such as scaling on the OSD image and etching on the image obtained by combining the OSD image with the video. It is possible that only the OSD image memorized in the image memorizing portion106is displayed on the display105.

When recording on the HDD116is requested, the broadcast signal obtained by the tuner102is fed through the CPU111to the HDD116and is recorded on the HDD116. When the method of encoding the moving picture content file to be recorded on the HDD116differs from that used by the decoder103, the video signal and the audio signal obtained through decoding by the decoder103are encoded based on the encoding method for recording on the HDD116, and are then recorded on the HDD116.

When reproduction from the HDD116is requested, the moving picture content file recorded on the HDD116is read, and is fed through the CPU111to the decoder103. Then, when the moving picture content file is converted into a video signal and an audio signal by the decoder103, video and audio corresponding to the video and audio signals are reproduced and outputted from the display105and the speaker110, respectively. When the method of encoding the moving picture content file to be recorded on the HDD116differs from that used by the decoder103, the moving picture content file read from the HDD116is decoded based on the encoding method for recording on the HDD116, and thus video and audio signals are acquired. Thereafter, the acquired video and audio signals are fed to the display control portion106and the amplifier109, and then video and audio are reproduced and outputted from the display105and the speaker110, respectively.

In the wireless communication module115, a wireless communication signal received from the remote controller2is demodulated and decoded based on a wireless communication method. Here, when a wireless communication signal carrying manipulation request data for the TV apparatus1is received, the manipulation request data is analyzed by the CPU111, and, based on the manipulation request data, instructions are fed to relevant blocks; in the case of audio data acquired by the remote controller2, it is fed to and recorded in the audio data memory114.

In the wireless communication module115, various types of data to be fed to the remote controller2are encoded and modulated based on the wireless communication method. Here, to the wireless communication module115is fed: from the CPU111, status data indicating the status of the TV apparatus1to the remote controller2; from the audio data memory114, audio data including recorded sound source data; and from the audio encoder113, audio data obtained by encoding an audio signal from the decoder103.

The configuration and operation of the remote controller2in the remote control system configured as described above will now be outlined below. As shown inFIG. 1, the remote controller2is provided with: a manipulation portion201that is manipulated by a user; a wireless communication module202that performs wireless communication with the TV apparatus1; a watchdog203that feeds, to a CPU204, a signal for bringing the remote controller2into operation from a sleep state when the manipulation portion201is manipulated or when the wireless communication module202receives a wireless communication signal from the TV apparatus1; a CPU204that controls the entire units of the remote controller2; a memory205in which programs for performing various operations are memorized; and a power supply portion206that supplies electric power to different blocks of the remote controller2.

The remote controller2is further provided with: an audio decoder207that decodes audio data including sound source data by an encoding method such as an ADPCM method (the same encoding method as used in the audio encoder113in the TV apparatus1); a DAC208that converts an audio signal decoded by the audio decoder207into an analog signal; an amplifier209amplifying an audio signal that is obtained by the DAC208and is in the form of an analog signal; and a speaker210that outputs audio based on the audio signal amplified by the amplifier209.

The remote controller2is further provided with: a microphone211that converts external sound into an audio signal in the form of an electric signal; an ADC (analog-to-digital converter)212that converts the audio signal in the form of an analog signal obtained by the microphone211into a digital signal; an audio encoder213that encodes the audio signal obtained by the ADC212by the same encoding method as used in the audio decoder207; an audio data memory214in which audio data from the audio encoder213and audio data received by the wireless communication module202are temporarily memorized; and a vibration unit215that mechanically vibrates the remote controller2.

In the remote controller2configured as described above, when the wireless communication module202receives a wireless communication signal from the TV apparatus1, it demodulates and decodes it based on the wireless communication method. Here, when status data is obtained from the received wireless communication signal, the status data is fed to the CPU204, where its contents are analyzed.

When the audio data including sound source data is obtained from the received wireless communication signal, this audio data is temporarily memorized in the audio data memory214. Then, when the audio data memorized in the audio data memory214is read and fed to the audio decoder207, it is decoded by the same encoding method as used in the audio encoder113in the TV apparatus1, and is then converted into an analog signal by the DAC208. This audio signal in the form of an analog signal is fed to the amplifier209, and then audio corresponding to the received audio data is reproduced and outputted from the speaker210.

The manipulation portion201is configured with a unit for manipulating the GUI (graphic user interface) of the OSD image displayed on the display105in the TV apparatus1. Specifically, it is configured with a simply structured unit that allows: position setting manipulation for moving a pointer vector two-dimensionally in the OSD image displayed; and item specifying manipulation for determining an item indicated by the pointer vector. When the manipulation portion201is manipulated, the contents of the manipulation are fed to the CPU204, where manipulation request data is generated. This manipulation request data is fed to the wireless communication module202, where it is encoded and modulated based on the wireless communication method and is then converted into a wireless communication signal; it is then transmitted to the TV apparatus1.

The manipulation portion201can be simply configured, such as by the use of a three-dimensional (3D) force sensor or a touch panel, to allow the position setting manipulation or the item specifying manipulation described above. When the manipulation portion201configured with the 3D force sensor, the touch panel or the like is manipulated two-dimensionally in a direction horizontal to the plane on which the manipulation portion201is provided, the position setting manipulation for indicating that direction is achieved; When it is manipulated in a direction vertical to the plane on which the manipulation portion201is provided, the item specifying manipulation for determining an item is achieved.

When external sound is inputted through the microphone211, it is converted into an audio signal in the form of an electric signal by the microphone211, and the audio signal in the form of an analog signal is then converted into a digital signal by the ADC212. This audio signal in the form of a digital signal is then fed to the audio encoder213, where it is encoded by an encoding method such as an ADPCM method, with the result that audio data is obtained.

The audio data obtained through encoding by the audio encoder213is fed to and memorized in the audio data memory214. In a case where the audio data thus memorized in the audio data memory214is transmitted to and memorized in the TV apparatus1, the audio data is read and fed to the wireless communication module202, where it is encoded and modulated based on the wireless communication method. Thus, it is converted into a wireless communication signal and is then transmitted to the TV apparatus1.

While the manipulation portion201is not manipulated or a wireless communication signal is not received by the wireless communication module202, in order to reduce electric power supplied from the power supply portion206to achieve lower power consumption, the remote controller2is kept in a sleep state in which electric power from the power supply portion206is supplied only to the wireless communication module202, the watchdog203and part of the CPU204. In this sleep state, the watchdog203checks whether a manipulation is performed on the manipulation portion201and whether reception is performed by the wireless communication module202, every predetermined period T0. When the watchdog203finds either that a manipulation is performed on the manipulation portion201or that a wireless communication signal is received by the wireless communication module202, the watchdog203notifies the CPU204of it to exit the sleep state. Here, electric power is also supplied to blocks that have not received electric power from the power supply portion206, and thus the remote controller2is brought into an ON state.

The vibration unit215vibrates the remote controller2according to audio reproduced and outputted from the speaker210. This vibration may be varied in combination of vibration cycles, vibration duration or the like according to the audio reproduced and outputted.

(Various Types of Operation Processing by Remote Controller)

The various types of operation processing by the remote controller2in the remote control system where the TV apparatus1and the remote controller2are configured as described above will be described in detail below.

(1) Basic Operation

The operation of the remote controller2when the manipulation portion201is manipulated to bring the remote controller2into operation from the sleep state will first be described with reference to a flow chart shown inFIG. 2.FIG. 2is a flow chart showing the basic operation of the remote controller2. As described previously, when the watchdog203detects a signal from the manipulation portion201to find that the manipulation portion201has been manipulated, the basic operation induced by the manipulation on the manipulation portion201starts (STEP1).

When the manipulation on the manipulation portion201is detected, the watchdog203notifies the CPU204of it and the sleep state is exited by the CPU204. Thus, the power supply portion206is so controlled as to supply electric power to the entire CPU204. (STEP2). The supply of power from the power supply portion206is so controlled by the CPU204that it supplies electric power to a block that is involved in each operation, the description of which will be omitted below.

Then, the CPU204checks whether or not the signal from the manipulation portion201corresponds to an item specifying manipulation (STEP3). In a case where the manipulation portion201is formed with the 3D force sensor, such an item specifying manipulation is performed in a direction vertical to the plane on which the 3D force sensor is provided as the manipulation portion201. The item specifying manipulation includes the function of, when the power to the TV apparatus1is off, turning on the power to the TV apparatus1.

If the signal from the manipulation portion201shows that the item specifying manipulation has been performed (“Yes” in STEP3), manipulation request data for checking whether or not the power to the TV apparatus1is on is generated by the CPU204, and is transmitted from the wireless communication module202(STEP4). Then, whether or not the power to the TV apparatus1is on is checked according to whether or not a response signal in the form of a wireless communication signal from the TV apparatus1is received by the wireless communication module202within a predetermined period T1(STEP5).

If the wireless communication module202does not receive the wireless communication signal transmitted from the TV apparatus1within the predetermined period T1(“No” in STEP5), manipulation request data for requesting the turning on of the power to the TV apparatus1is generated by the CPU204and is transmitted in the form of a wireless communication signal from the wireless communication module202to the TV apparatus1(STEP6). The operation in STEP6may be performed, not only if the wireless communication module202receives the wireless communication signal, but also if status data carried by the received wireless communication signal does not show that the power to the TV apparatus1is on.

Thereafter, the wireless communication signal from the TV apparatus1is received within a predetermined period T2, and the CPU204checks whether or not the wireless communication signal is one carrying status data indicating that the power has been on (STEP7). Here, if the CPU204finds that the status data carried by the received wireless communication signal shows that the power to the TV apparatus1has been turned on (“Yes” in STEP7), the CPU204receives the wireless communication signal transmitted from the TV apparatus1through the wireless communication module202, and generates manipulation request data requesting the display of an OSD image (STEP8).

Then, the wireless communication signal of this manipulation request data is transmitted to the TV apparatus1from the wireless communication module202. Also, if the status data carried by the wireless communication signal shows that the power has been on (“Yes” in STEP5), then the process proceeds to STEP8, where the wireless communication signal of the manipulation request data requesting the display of the OSD image is transmitted to the TV apparatus1. An example of the OSD image displayed on the display105in the TV apparatus1is shown inFIG. 3. The display of the OSD image shown inFIG. 3will be described later.

The period that elapses after the transmission of the wireless communication signal requesting the display of the OSD image is measured by the CPU204, and whether or not a position setting manipulation is performed on the manipulation portion201within a predetermined period T3is checked by the CPU204(STEP9). Here, if it is found that no manipulation is performed on the manipulation portion201(“No” in STEP9), manipulation request data requesting the transmission of sound source data is generated by the CPU204, and is transmitted in the form of a wireless communication signal from the wireless communication module202(STEP10). Specifically, in order for the user to be prompted to move the pointer vector on the OSD image displayed on the display105in the TV apparatus1, the TV apparatus1is requested to transmit sound source data for the voice “move the pointer.”

Thereafter, when it is found that the wireless communication module202has received the wireless communication signal of the sound source data from the TV apparatus1, the received wireless communication signal is demodulated and decoded, and thus the sound source data is obtained and is memorized in the audio data memory214(STEP11). When this sound source data memorized in the audio data memory214is read by the audio decoder207, it is decoded by an encoding method such as an ADPCM method, is converted into an analog signal by the DAC208, is then amplified by the amplifier209, and is reproduced and outputted from the speaker210(STEP12). Here, in order to request the user to perform a position setting manipulation, the voice “move the pointer” is reproduced and outputted from the speaker210.

The period that elapses after the voice “move the pointer” is reproduced and outputted is measured by the CPU204, and whether or not a position setting manipulation is performed on the manipulation portion201within a predetermined period T4is checked by the CPU204(STEP13). If, in STEP9or STEP13, the position setting manipulation is found to have been performed (“Yes”), manipulation request data indicating the direction specified by the position setting manipulation on the manipulation portion201is generated by the CPU204, and is transmitted in the form of a wireless communication signal from the wireless communication module202(STEP14). Specifically, the movement direction of the pointer vector on the OSD image displayed on the display105in the TV apparatus1is determined by the position setting manipulation, and manipulation request data indicating the movement direction is generated by the CPU204. Also if, in STEP3, the position setting manipulation is performed on the manipulation portion201(“No”), the process proceeds to STEP14.

When, in STEP14, the wireless communication signal of the manipulation request data indicating the direction specified by the position setting manipulation is transmitted, the wireless communication module202receives, from the TV apparatus1, the wireless communication signal of status data having information on the position indicated by the pointer vector on which the manipulation has been performed (STEP15). Here, if the position indicated by the pointer vector is within the region for specifying remote controller manipulation processing, a wireless communication signal of status data having information indicating the item of the remote controller manipulation processing in that region is transmitted from the TV apparatus1. If the position indicated by the pointer vector is not within the region for specifying the remote controller manipulation processing, a wireless communication signal of status data having information indicating that no remote controller manipulation processing is specified is transmitted from the TV apparatus1.

Then, from the status data obtained from the wireless communication signal received by the wireless communication module202, the item corresponding to the position indicated by the pointer vector on the OSD image displayed on the display105in the TV apparatus1is analyzed by the CPU104to check whether or not one item of remote controller manipulation processing is being indicated by the pointer vector (STEP16). Specifically, whether or not on the OSD image displayed on the display105in the TV apparatus1, the position of the pointer vector is within the region for specifying remote controller manipulation processing is checked.

If the status data of the received wireless communication signal indicates one item of the remote controller manipulation processing (“Yes” in STEP16), the remote controller manipulation processing indicated by the status data is temporarily memorized in the memory205(STEP17). By contrast, if the status data of the received wireless communication signal shows that no item of remote controller manipulation processing is indicated (“No” in STEP16), the process proceeds to STEP9, where whether or not the following position setting manipulation has been performed on the manipulation portion201is checked within the predetermined period T3after the previous position setting manipulation is found.

Then, after the memorizing operation is performed in STEP17, as in STEPs10through12, a wireless communication signal of manipulation request data requesting the transmission of sound source data is transmitted (STEP18), then the sound source data from the received wireless communication signal is memorized in the audio data memory214(STEP19), and this audio data is decoded by the audio decoder207, with the result that audio is reproduced and outputted from the speaker210(STEP20). At this point, in order for the user to be prompted to determine the item of processing indicated by the pointer vector on the OSD image displayed on the display105in the TV apparatus1, sound source data for the voice “determine” is requested from the TV apparatus1and received, and is reproduced and outputted from the speaker210.

Then, the period that elapses after the voice “determine” is reproduced and outputted is measured by the CPU204, and whether or not an item specifying manipulation has been performed on the manipulation portion201within a predetermined period T5is checked by the CPU204(STEP21). The processing operation corresponding to the remote controller manipulation processing memorized in the memory205is performed (STEP22). The remote controller manipulation processing operation in STEP21will be described later.

If, in STEP7, it is found that the wireless communication signal indicating the turning on of the power to the TV apparatus1has not been received within the predetermined period T2(“No”), sound source data for an warning announcement memorized in the audio data memory214is read, and is reproduced and outputted from the speaker210(STEP23). Specifically, sound source data for the voice “the power is not on” or “communication is impossible” is read from the audio data memory214, is decoded by the audio decoder207, and is converted into an analog signal by the DAC208. Then, an audio signal carrying the voice for the warning announcement is amplified by the amplifier209, and is reproduced and outputted from the speaker210.

When the voice for the warning announcement is reproduced and outputted from the speaker210in this way, the CPU204checks whether or not the audio announcement reproduced and outputted from the speaker210has been completed (STEP24). If, in STEP13or21, the requested manipulation has not been performed on the manipulation portion201(“No”), the process likewise proceeds to STEP24, where whether or not the audio announcement reproduced and outputted has been completed is checked.

Then, if, in STEP24, the CPU204finds that the audio announcement being presently reproduced and outputted from the speaker210has been completed (“Yes”), the remote controller2enters the sleep state (STEP25). Specifically, the CPU204controls the power supply portion206so that it supplies electric power only to the wireless communication module202, the watchdog203and part of the CPU204and stops the supply of electric power to the other blocks, with the result that the sleep state is entered.

(1-1) Another Example 1 of Basic Operation

In the operation described above, when, in STEPs3through8, the item specifying manipulation is performed on the manipulation portion201and the sleep state is exited, whether or not the TV apparatus1is on is checked and, if the TV apparatus1is on or is turned on, the display of an OSD image is requested. Alternatively, it is possible, irrespective of whether the exit of the sleep state is triggered by a position setting manipulation or an item specifying manipulation on the manipulation portion201, to check whether or not the TV apparatus1is on and to request, if the TV apparatus1is on or is turned on, the display of an OSD image.

Here, for example, after the sleep state is exited in STEP2, the operations in STEPs4through7are performed to check whether or not the TV apparatus1is on and, if the power to the TV apparatus1is not on, a wireless communication signal requesting the power to be turned on is transmitted. Then, after the display of an OSD image is requested in STEP8, the process may proceed to STEP3, where whether the manipulation performed on the manipulation portion201is an item specifying manipulation or a position setting manipulation is checked.

(1-2) Another Example 2 of Basic Operation

If the same operations as those described above in STEPs3through8are performed and, in STEP3, the manipulation performed on the manipulation portion201is found to be a position setting manipulation (“No”), the same operations as those described above in STEPs4and5may be performed to check whether or not the power to the TV apparatus1is on. Here, if the power to the TV apparatus1is found to be on, the process proceeds to STEP14, where the wireless communication signal of the manipulation request data indicating the position setting manipulation is transmitted. By contrast, if the power to the TV apparatus1is found not to be on, the process proceeds to STEP21, where the warning announcement indicating that the power to the TV apparatus1is not on is reproduced and outputted from the speaker210.

(1-3) Another Example 3 of Basic Operation

If, in STEP3, the manipulation performed on the manipulation portion201is found to be a position setting manipulation, and then the power to the TV apparatus1is found to be on, a wireless communication signal for requesting the TV apparatus1to find whether or not the OSD image is displayed may be transmitted. If the OSD image is found to be displayed, as in STEP8, the wireless communication signal for requesting the display of the OSD image is transmitted, and then the process proceeds to STEP14. If the OSD image is displayed, the process proceeds directly to STEP14.

(1-4) Another Example 4 of Basic Operation

After, in STEP8, the TV apparatus1is requested to display the OSD image, whether or not during the processing operations in STEPs9through12, an item specifying manipulation has been performed on the manipulation portion201may be checked. Here, if, during the processing operations in STEPs9through12, an item specifying manipulation has been performed on the manipulation portion201, the process proceeds to STEP20, where the wireless communication signal of the manipulation request data indicating that the item specifying manipulation has been performed is transmitted. Then the item of processing specified by the pointer vector on the OSD image displayed on the display105is found, and the remote controller manipulation processing corresponding to the specified item of processing is performed.

(2) OSD Image Display

The display of the OSD image on the display105in the TV apparatus1will now be described briefly with reference to a display example shown inFIG. 3. In the TV apparatus1, when the OSD image is displayed on the display105, an image signal of the OSD image memorized in the image memorizing portion106is combined, by the display control portion104, with a video signal obtained by the decoder103such that the image signal is superimposed on the video signal. As a result, as shown inFIG. 3, the OSD image is so displayed as to be superimposed on the video corresponding to a broadcast signal selected by the tuner102or a moving picture content file read from the HDD116.

Here, in the screen display on the display105shown inFIG. 3, the following items are displayed as the OSD image so as to be superimposed on the video of the video signal obtained by the decoder103: a pointer vector500for pointing different regions; a menu button region501for displaying a menu for selecting items of remote controller manipulation processing; a volume setting region502in which a button for setting the volume of audio reproduced and outputted from the speaker110in the TV apparatus1and the status of the volume are displayed; a channel setting region503in which a button for setting the channel selected by the tuner102in the TV apparatus1and the selected channel are displayed; a numeric key pad region504for entering numbers and symbols; a power off region505for turning off the power to the TV apparatus1; and a screen return region506for returning the OSD image to the previous screen or for hiding the OSD image.

When the OSD image is displayed on the display105in this way, if a wireless communication signal transmitted from the remote controller2shows that a position setting manipulation has been performed, the pointer vector500moves, on the screen of the display105, in the direction (vector quantity) indicated by the position setting manipulation. When the wireless communication signal transmitted from the remote controller2shows that an item specifying manipulation has been performed, the manipulation corresponding to the region pointed by the pointer vector500is performed.

Here, if the pointer vector500is located in the menu button region501and an item specifying manipulation is performed on the remote controller2, a menu is displayed for specifying various setting operations such as of a recorder function by the remote controller2, a sub screen display function, a recording/reproduction function to the HDD116and the volume setting function of the remote controller2. The image for this menu is also displayed, as the OSD image accompanied by the pointer vector500, so as to be superimposed on the video from the decoder103as in the example of the display shown inFIG. 3.

The volume setting region502is composed of: a button region502ain which, when it is specified by the pointer vector500, the volume is increased in steps of a predetermined amount; a button region502bin which when it is specified by the pointer vector500, the volume is decreased in steps of a predetermined amount; and a volume bar region502cin which the current status of the volume is displayed and, when a position on it is specified by the pointer vector500, the volume is set at an appropriate amount.

The channel setting region503is composed of: a button region503ain which, when it is specified by the pointer vector500, the channel is increased in steps of one channel; a button region503bin which when it is specified by the pointer vector500, the channel is decreased in steps of one channel; and a channel display region503cin which the current channel is displayed. By specifying a number in the numeric keypad region504with the pointer vector500, it is also possible to specify a desired channel number.

For example, when the screen of the OSD image serving as the above-mentioned menu is displayed, if the screen return region506is specified by the pointer vector500, the screen returns to that of the OSD image shown inFIG. 3. When the screen of the OSD image shown inFIG. 3is displayed, if the screen return region506is specified, the OSD image is hidden, and only the video of the video signal obtained by the decoder103is reproduced and displayed on the display105. The processing performed when the screen return region506is specified will hereinafter be called “screen-return processing.”

(3) Remote Controller Manipulation Processing Operation

The remote controller manipulation processing operation in STEP22in the basic operation according to the flow chart ofFIG. 2will now be described with reference to the flow chart ofFIG. 4. The CPU204first reads, in STEP17, the contents of the remote controller manipulation processing memorized in the memory203, and checks whether or not the remote controller manipulation processing is power-off processing for turning off the power to the TV apparatus1(STEP401).

If the remote controller manipulation processing that has been subjected to the check is not the power-off processing (“No” in STEP401), then the CPU204checks whether or not the remote controller manipulation processing read from the memory203is screen-return processing for returning the screen on the display105to the previous screen STEP402). Here, if the checked remote controller manipulation processing is not the screen-return processing (“No” in STEP402), the CPU204finds the operation status memorized in the memory203to check whether or not an audio guidance function on the remote controller2is on (STEP403).

If the audio guidance function is found to have been turned on (“Yes” in STEP403), the CPU204first checks whether or not the checked remote controller manipulation processing is either channel setting processing or volume setting processing on the TV apparatus1(STEP404). Here, if it is either the channel setting processing or the volume setting processing on the TV apparatus1(“Yes” in STEP404), then the CPU204transmits to the TV apparatus1a wireless communication signal of manipulation request data indicating that an item specifying manipulation has been performed and determined (STEP405).

Specifically, the TV apparatus1simply performs a setting operation according to the region specified by the pointer vector within the OSD image displayed on the display105in the TV apparatus1, and thus manipulation request data indicating that an item specifying manipulation has been performed and determined is generated by the CPU204. Then, a wireless communication signal of this manipulation request data is transmitted from the wireless communication module202to the TV apparatus1. Thus, the TV apparatus1performs the setting operation corresponding to the region currently being specified by the pointer vector. That is, in the TV apparatus1, the setting of the channel selected by the tuner102or the setting of the volume of the speaker110is performed.

Thereafter, if the checked remote controller manipulation processing is found to be neither the channel setting processing nor the volume setting processing on the TV apparatus1(“No” in STEP404) or if the transmission of the wireless communication signal is completed in STEP405, then whether or not the remote controller manipulation processing checked by the CPU204is menu browsing processing for setting various functions such as the above-described recorder function and sub screen display function (STEP406).

Here, if the checked remote controller manipulation processing is found to be the menu browsing processing (“Yes” in STEP406), as in STEP405, a wireless communication signal of manipulation request data indicating that an item specifying manipulation has been performed and determined is transmitted to the TV apparatus1(STEP407). Accordingly, the TV apparatus1finds the region (the menu button region501inFIG. 3) currently specified by the pointer vector. Then, a menu is displayed to specify various setting operations such as of the recorder function by the remote controller2, the sub screen display function, the recording/reproduction function to the HDD116and the volume setting function of the remote controller2.

Thereafter, as in STEPs10through12in the flow chart ofFIG. 2, a wireless communication signal of manipulation request data requesting the transmission of sound source data is transmitted (STEP408), the sound source data from the received wireless communication signal is memorized in the audio data memory214(STEP409) and this audio data is decoded by the audio decoder207, with the result that audio is reproduced and outputted from the speaker210(STEP410). Here, in order for the user to be prompted to select from the various setting operations shown in the menu of the OSD image displayed on the display105in the TV apparatus1, sound source data for the voice “select from menu” is requested from the TV apparatus1and received, and is reproduced and outputted from the speaker210.

If the checked remote controller manipulation processing is found not to be the menu browsing processing (“No” in STEP406) or if the announcement is made in STEP410, the CPU204finds the contents memorized in the CPU204to check whether or not the manipulation was performed when the menu of the OSD image was displayed on the display105in the TV apparatus1(STEP411). Specifically, when the screen of the OSD image displayed on the display105in the TV apparatus1was the menu display screen that was displayed by the selection of the menu button region501in the display shown inFIG. 3, whether or not the screen of the OSD image displayed on the display105in the TV apparatus1was determined by the manipulation of the remote controller2is checked.

If, in STEP411, it is found that the manipulation was performed when the menu was displayed by the OSD image on the display105and that processing corresponding to one of the functions specified through the menu has been specified (“Yes”), the CPU204finds the contents of the memory205to check whether or not the sub screen display function is specified (STEP412). If the sub screen display function is found to have been specified (“Yes” in STEP412), a sub screen display processing operation, which will be described later, is performed (STEP413).

If the sub screen display function have not been specified (“No” in STEP412) or if the sub screen display processing operation has been performed in STEP413, then whether or not the recorder function by the remote controller2has been specified according to the contents memorized in the memory205is checked (STEP414). If the recorder function by the remote controller2is found to have been specified (“Yes” in STEP414), the recorder processing operation, which will be described later, is performed (STEP415).

If the recorder function by the remote controller2has not been specified (“No” in STEP414) or if the recorder processing operation is performed in STEP415, then whether or not a function other than those achieved by the processing operations performed in STEPs413and415has been specified according to the contents memorized in the memory205is checked (STEP416). If it is found that any one of the functions specified when the OSD image in the form of the menu was displayed on the display105in the TV apparatus1is specified (“Yes” in STEP416), processing operation corresponding to the function thus found is performed (STEP417). The processing operation performed in STEP417is called a “setting processing operation”, which will also be described later.

If the manipulation is found not to have been performed when the menu was displayed by the OSD image on the display105(“No” in STEP411) or if it is found that none of the functions selectable, when the menu was displayed, was selected (“No” in STEP416), as in STEP24in the flow chart ofFIG. 2, the CPU204checks whether or not the audio announcement reproduced and outputted from the speaker210is completed (STEP418).

If the checked remote controller manipulation processing is the power-off processing or the screen-return processing (“Yes” in STEP401or STEP402) or if the audio guidance function on the remote controller2is off (“No” in STEP403), then the CPU204transmits to the TV apparatus1a wireless communication signal of manipulation request data indicating that an item specifying manipulation has been performed and determined so that the remote controller manipulation processing found from the memory203is performed (STEP419).

Specifically, when the wireless communication signal is transmitted in STEP419, if the process shifts from STEP401, the TV apparatus1performs the power-off processing, or if the process shifts from STEP402, the TV apparatus1performs the screen-return processing. If the process shifts from STEP403, the specified remote controller manipulation processing other than the power-off processing and screen return processing is performed in the TV apparatus1.

When the CPU204finds that the audio announcement reproduced and outputted from the speaker210has been completed (“Yes” in STEP418) or the wireless communication signal is transmitted to the TV apparatus1in STEP419, the CPU204checks whether or not a predetermined period T6has elapsed since the manipulation portion201was last manipulated. If, in STEP420, the CPU204finds that the predetermined period T6has elapsed or finds that the predetermined period T6elapsed (“Yes”), as in STEP25in the flow chart ofFIG. 2, the remote controller2enters the sleep state (STEP421).

(4) Sub Screen Display Processing Operation

The sub screen display processing operation in STEP413in the remote controller manipulation processing operation according to the flow chart ofFIG. 4will now be described with reference to a flow chart shown inFIG. 5. First, in order to activate the sub screen display function on the TV apparatus1, a wireless communication signal derived from manipulation request data indicating that an item specifying manipulation has been performed and determined is transmitted to the TV apparatus1(STEP501). Thus, in the TV apparatus1, the manipulation request data of the wireless communication signal shows that the sub screen display function has been specified, and, as shown inFIG. 6, an image reproduced and outputted on the display105is composed of a sub screen601and a main screen600such that the sub screen601is superimposed on the main screen600.

Thereafter, whether or not the position setting manipulation has been performed on the manipulation portion201is checked by the CPU204(STEP502). If the position setting manipulation is found to have been performed (“Yes”), a wireless communication signal of manipulation request data indicating the direction specified by the position setting manipulation on the manipulation portion201is transmitted to the TV apparatus1(STEP503). When the TV apparatus1receives the wireless communication signal indicating the direction specified by the position setting manipulation on the manipulation portion201, the sub screen601displayed as shown inFIG. 6is shifted in the direction specified by the remote controller2.

If no position setting manipulation has been performed (“No” in STEP502) or the wireless communication signal is transmitted in STEP503, whether or not an item specifying manipulation has been performed on the manipulation portion201is checked by the CPU204(STEP504). Here, if the item specifying manipulation is found to have been performed (“Yes”), whether or not a press-and-hold manipulation in which the manipulation portion201is held manipulated for a predetermined period t has been performed (STEP505) is checked. If no item specifying manipulation has been found (“No” in STEP504), the process proceeds to STEP502.

Then, if the CPU204finds that the period for which the item specifying manipulation has been performed on the manipulation portion201is within the predetermined period t (that the performed manipulation is not the press-and-hold manipulation) (“No” in STEP505), the CPU204increments by one and memorizes in the memory205a count k of how many times an item specifying manipulation has been performed (STEP506). If the CPU204checks whether or not the count k of how many times an item specifying manipulation has been performed is one (STEP507) and finds that the count k is one (“Yes”), manipulation request data requesting the transmission of audio corresponding to the video on the sub screen601is generated by the CPU204, and is transmitted in the form of a wireless communication signal to the TV apparatus1(STEP508). It is assumed that the count k is initialized to zero when the sleep state is entered.

Thereafter, when the wireless communication module202receives the wireless communication signal of audio data corresponding to the video reproduced and outputted on the display105in the TV apparatus1, the received audio data is decoded (STEP509), then an operation of reproducing the recorded audio is started (STEP510) and the process proceeds to STEP502. Here, in the TV apparatus1, an audio signal corresponding to the video on the sub screen601is encoded with the audio encoder113by an encoding method such as an ADPCM method, is then converted into a wireless communication signal by the wireless communication module115and is then transmitted to the remote controller2. In the remote controller2, when this wireless communication signal is received by the wireless communication module202, the audio data is acquired from the wireless communication signal and is temporarily memorized in the audio data memory214.

Then the audio data memorized in the audio data memory214is read, is fed to the audio decoder207and is decoded by an encoding method such as an ADPCM method, and is then converted into an audio signal in the form of an analog signal by the DAC208. Thus, audio based on audio data corresponding to the video on the sub screen601that is reproduced and outputted on the display105in the TV apparatus1is reproduced and outputted from the speaker210in the remote controller2.

If the count k is not one (“No” in STEP507), whether or not the count k is two is checked by the CPU204(STEP511). If the count k is two (“Yes” in STEP511), manipulation request data requesting the transmission of audio corresponding to the video on the main screen600is generated by the CPU204, and is transmitted in the form of a wireless communication signal to the TV apparatus1(STEP512). Specifically, the audio output from the speaker210in the remote controller2is switched from the audio corresponding to the video on the sub screen601to the audio corresponding to the video on the main screen600.

Furthermore, manipulation request data requesting stop of the audio output from the speaker110in the TV apparatus1(muting of the television audio) is generated by the CPU204, and is transmitted in the form of a wireless communication signal to the TV apparatus1(STEP513). When the TV apparatus1receives this wireless communication signal, the TV apparatus1performs a muting function, and thus the audio corresponding to the video on the main screen600stops being reproduced and outputted from the speaker110.

Thereafter, the operations in STEPs509and510are performed, and thus, in the TV apparatus1, the audio signal corresponding to the video on the sub screen601stops being encoded by the audio encoder113. Instead, the audio signal corresponding to the video on the main screen600is encoded by the audio encoder113, is then converted into a wireless communication signal by the wireless communication module115, and is transmitted to the remote controller2. In the remote controller2, when this wireless communication signal is received by the wireless communication module202, audio data is acquired from the wireless communication signal, and is temporarily memorized in the audio data memory214.

Then the audio data memorized in the audio data memory214is read, is fed to the audio decoder207and is decoded by an encoding method such as an ADPCM method, and is then converted into an audio signal in the form of an analog signal. Thus, audio based on audio data corresponding to the video on the main screen600that is reproduced and outputted on the display105in the TV apparatus1is reproduced and outputted from the speaker210in the remote controller2.

When the count k is not two (“No” in STEP511), manipulation request data requesting stop of transmission of audio data is generated by the CPU204, and is transmitted in the form of a wireless communication signal to the TV apparatus1(STEP514). Furthermore, manipulation request data requesting the cancellation of the function of muting the television audio is generated by the CPU204, and is transmitted in the form of a wireless communication signal to the TV apparatus1(STEP515). The count k is initialized to zero (STEP516), and then the process proceeds to STEP502.

In this way, in the TV apparatus1, the audio signal corresponding to the video on the main screen600stops being encoded by the audio encoder113, and the wireless communication signal stops being transmitted from the wireless communication module115. Furthermore, the muting function is canceled, and the audio signal corresponding to the video on the main screen600is fed to the amplifier109, with the result that the audio corresponding to the video on the main screen600is reproduced and outputted from the speaker110.

If the CPU204finds that the period for which an item specifying manipulation has been performed on the manipulation portion201is longer than the predetermined period t (that the performed manipulation is the press-and-hold manipulation) (“Yes” in STEP505), manipulation request data requesting the removal of the sub screen601is generated by the CPU204, and is transmitted in the form of a wireless communication signal to the TV apparatus1(STEP517). Thus, in the TV apparatus1, only a video signal corresponding to the main screen600is fed from the decoder103to the display control portion104, with the result that the main screen600is only displayed on the display105. Thereafter, as in STEP25in the flow chart ofFIG. 2, the remote controller2enters the sleep state (STEP518).

(5) Recorder Processing Operation

The recorder processing operation in STEP415in the remote controller manipulation processing operation according to the flow chart ofFIG. 4will now be described with reference to a flow chart shown inFIG. 7. First, in order to activate the recorder function by the remote controller2in the TV apparatus1, a wireless communication signal of manipulation request data indicating that an item specifying manipulation has been performed and determined is transmitted to the TV apparatus1(STEP701). Thereafter, the CPU204checks whether or not a manipulation for the reproduction operation of recorded audio has been performed on the manipulation portion201in the remote controller2(STEP702).

The manipulation for the reproduction operation in STEP702may be determined, for example, by indicating a predetermined direction (a first direction) through a position setting manipulation on the manipulation portion201. In the case of the manipulation for the reproduction operation being determined by indicating the first direction through the position setting manipulation in the following step, STEP703, manipulation request data requesting the reproduction operation may be generated by the CPU204or simply manipulation request data indicating the first direction of the position setting manipulation may be generated by the CPU204. The GUI function in the TV apparatus1may be utilized such that the position setting manipulation is performed in the OSD image displayed on the display105to specify a predetermined region (the first region) and then an item specifying manipulation is performed to determine it.

If the manipulation for the reproduction operation is found to have been performed (“Yes” in STEP702), manipulation request data that indicates the determination by performing the reproduction operation is generated by the CPU204, and a wireless communication signal of this manipulation request data is transmitted to the TV apparatus1(STEP703). Thereafter, when the wireless communication module202receives a wireless communication signal of audio data recorded in the TV apparatus1, the received audio data is decoded (STEP704), and the reproduction operation of the recorded audio is started (STEP705).

Here, in the TV apparatus1, the audio data memorized in the audio data memory114is read, is then converted into a wireless communication signal by the wireless communication module115and is transmitted to the remote controller2. In the remote controller2, when this wireless communication signal is received by the wireless communication module202, the audio data is acquired from the wireless communication signal, and is temporarily memorized in the audio data memory214.

Thereafter, the audio data memorized in the audio data memory214is read, is fed to the audio decoder207and is decoded by an encoding method such as an ADPCM method, and is then converted into an audio signal in the form of an analog signal by the DAC208. Thus, audio based on audio data memorized in the audio data memory114in the TV apparatus1is reproduced and outputted from the speaker210in the remote controller2.

When the audio recorded in the audio data memory114in the TV apparatus1is reproduced and outputted in this way, the CPU204checks whether or not the reproduction has been completed (STEP706). Specifically, the reception of the wireless communication signal from the TV apparatus1is completed, and the CPU204checks that no audio data is buffered in the audio data memory214. By doing so, it is found that the reproduction of the recorded audio has been completed.

Instead of checking that all the audio data to be reproduced has been reproduced, the reproduction operation may be completed by checking that a manipulation for completing the reproduction operation has been performed on the manipulation portion201. In this case, for example, a determination may be made by performing a position setting manipulation to indicate the predetermined direction (the first direction) or a determination may be made by indicating another predetermined direction (a second direction). A determination may be made by utilizing the OSD image displayed on the TV apparatus1.

If no manipulation for the reproduction operation has been performed (“No” in STEP702), the CPU204checks whether or not a manipulation for the operation of recording sound inputted via the microphone211in the audio data memory114in the TV apparatus1has been performed on the manipulation portion201in the remote controller2(STEP707). This manipulation for the recording operation may also be determined by indicating a predetermined direction (a third direction) through a position setting manipulation on the manipulation portion201or may be determined by performing the position setting manipulation in the OSD image displayed on the display105to specify the predetermined region (the second region) and then performing an item specifying manipulation.

If the manipulation for the recording operation is found to have been performed (“Yes” in STEP707), an audio signal corresponding to sound inputted to the microphone211is fed to the ADC212and is converted into a digital signal sampled every predetermined period (STEP708), and is then encoded with the audio encoder213by an encoding method such as an ADPCM method (STEP709). The audio data obtained in this way is fed to the audio data memory214, and is temporarily memorized in the audio data memory214(STEP710).

Then, whether or not the amount of audio data buffered in the audio data memory214has exceeded a predetermined amount is checked by the CPU204(STEP711). If the amount of audio data memorized in the audio data memory214has exceeded the predetermined amount (“Yes” in STEP711), the audio data memorized in the audio data memory214is fed to the wireless communication module202, is then converted into a wireless communication signal and is then transmitted to the TV apparatus1. Thus, recorded audio data is transferred (STEP712).

If the amount of audio data memorized in the audio data memory214is equal to or less than the predetermined amount (“No” in STEP711) or the audio data is transferred in STEP712, whether or not a manipulation for completing the recording operation has been performed on the manipulation portion201in the remote controller2is checked by the CPU204(STEP713). This manipulation for completing the recording operation may also be performed in the same predetermined direction (the third direction) as when the position setting manipulation is performed on the manipulation portion201to specify the recording operation or may be determined in a predetermined direction (a fourth direction) different from when the recording operation is specified. It may be determined by performing a position setting manipulation in the OSD image displayed on the display105to specify the predetermined region (the third region) and then performing an item specifying manipulation.

If a manipulation for stopping the recording operation is found to have been performed (“Yes” in STEP713), the remaining audio data memorized in the audio data memory214(audio data whose amount is equal to or less than the predetermined amount) is read, is transmitted in the form of a wireless communication signal from the wireless communication module202and is transferred to the TV apparatus1(STEP714). Then, whether or not all the audio data memorized in the audio data memory214has been transferred is checked by the CPU204(STEP715). If all the audio data memorized in the audio data memory214has been transferred (“Yes” in STEP715), manipulation request data indicating the completion of the transfer operation of recorded audio data is generated by the CPU204and is then transmitted in the form of a wireless communication signal from the wireless communication module202to the TV apparatus1(STEP716).

If no manipulation for the recording operation has been performed (“No” in STEP707), whether or not a predetermined period T7has elapsed since the wireless communication signal indicating the operation of the recording function was transmitted in STEP701(STEP717) is checked by the CPU204. If the predetermined period T7has not elapsed yet (“No” in STEP717), the process proceeds to STEP702, where the operations in STEP702and the following steps are repeated.

Then, If the reproduction is found to have been completed (“Yes” in STEP706), if the wireless communication signal indicating the completion of the transfer operation is transmitted in STEP706or if the predetermined period T7is found to have elapsed (“Yes” in STEP717), as in STEP25in the flow chart ofFIG. 2, the remote controller2enters the sleep state (STEP718).

(5-1) Another Example of Recorder Function

The above description deals with the case where the start and stop of the reproduction operation and the start and stop of the recording operation are checked by the use of the direction specified by the position setting manipulation on the manipulation portion201and by the use of the GUI of the OSD image, respectively. However, when the manipulations are checked by pressing the manipulation portion201in the item specifying manipulation if it is kept pressed for a period longer than a predetermined period, that is, it is “pressed-and-held”, the recording manipulation may be determined to be performed, and if it is kept pressed for a period shorter than the predetermined period, the reproduction manipulation may be determined to be performed. While the recording manipulation or the reproduction manipulation is being performed, the recording manipulation or the reproduction manipulation currently being performed may be stopped by performing an item specifying manipulation on the manipulation portion201again

The above description deals with the case where, when the recorder processing operation is performed by the use of the remote controller2, the audio data inputted via the microphone211, that is, recording target audio data, is memorized in the audio data memory114in the TV apparatus1. However, when a large-capacity recording medium like the HDD116is provided or a removable recording medium is provided in addition to the HDD116, the recording target audio data may be recorded on the recording medium such as the HDD116. When the amount of audio data to be memorized is small or it is impossible to communicate with the TV apparatus1, the recording target audio may be recorded in the audio data memory214in the remote controller2.

(6) Setting Processing Operation

The setting processing operation in STEP417in the remote controller manipulation processing operation according to the flow chart ofFIG. 4will be described with reference to a flow chart shown inFIG. 8. First, in order to perform a function selected from the menu displayed in the OSD image in the TV apparatus1, a wireless communication signal of manipulation request data indicating that an item specifying manipulation has been performed and determined is transmitted to the TV apparatus1(STEP801). Thus, in the TV apparatus1, the manipulation request data of the wireless communication signal shows selected setting processing operation.

After the transmission of the wireless communication signal, the CPU204finds the contents memorized in the memory205to check whether or not the setting processing operation determined by the item specifying manipulation is the volume setting operation of the remote controller2(STEP802). If it is found that the volume setting operation of the remote controller2has been specified (“Yes” in STEP802), manipulation request data requesting the transmission of sound source data (test sound source data) that is reproduced and outputted to test the volume of the remote controller2is generated by the CPU204, and is transmitted in the form of a wireless communication signal through the wireless communication module202(STEP803).

Specifically, the TV apparatus1is requested to transmit the sound source data serving as the test sound reproduced and outputted from the speaker210so that the volume of audio outputted from the speaker210in the remote controller2is checked. This sound source data serving as the test sound is stored, like the other sound source data described previously, in the audio data memory114in the TV apparatus1. Thus, this test sound source data is read from the audio data memory114, is converted into a wireless communication signal by the wireless communication module115and is transmitted to the remote controller2from the TV apparatus1.

Then, when the wireless communication signal of the test sound source data is received by the wireless communication module202, the test sound source data obtained from the received wireless communication signal is memorized in the audio data memory214(STEP804). This test sound source data memorized in the audio data memory214is read, and is fed to the audio decoder207, where it is decoded by an encoding method such as an ADPCM (STEP805).

Thereafter, manipulation request data requesting the speaker110in the TV apparatus1to stop audio output (to mute the television audio) is generated by the CPU204, and is transmitted in the form of a wireless communication signal to the TV apparatus1(STEP806). The TV apparatus1receives this wireless communication signal and thus performs a muting function to stop the reproduction and output of audio from the speaker110.

In order for an audio announcement corresponding to the test sound source data to be reproduced and outputted repeatedly until the volume is determined, the audio signal obtained by decoding the test sound source data is temporarily stored in the audio decoder207(STEP807). The audio decoder207may be set such that, in order for the audio announcement to be reproduced and outputted repeatedly, the audio decoder207reads the test sound source data from the audio data memory214to decode it every time the output of the audio announcement is completed.

As described above, the audio decoder207is set such that the audio announcement is reproduced and outputted repeatedly, and then the audio signal decoded by the audio decoder207is converted into an analog signal by the DAC208and the audio announcement corresponding to the test sound source data is reproduced and outputted from the speaker210(STEP808). When the reproduction and output of this audio announcement is started, the volume of the audio announcement reproduced and outputted from the speaker210is varied by changing the amplification factor of the amplifier209(STEP809), and then whether or not volume obtained by varying the volume in STEP809has been determined as a result of an item specifying manipulation being performed on the manipulation section201is checked by the CPU204.

If the manipulation for determining the volume is not performed on the manipulation section201(“No” in STEP810), the process proceeds to STEP809, and the volume of the audio announcement reproduced and outputted from the speaker210is varied by changing the amplification factor of the amplifier209. If the manipulation for determining the volume is performed on the manipulation section201(“Yes” in STEP810), the amplification factor of the amplifier209is checked and a volume code corresponding to the amplification factor is memorized in the memory205(STEP811). Although the above description discusses the case where the volume is varied according to only the amplification factor of the amplifier209, the volume may be varied according to the amplification amount of the digital/analog conversion by the DAC208. In this case, the volume code may also include information on the amplification amount by the DAC208.

The volume code based on the set volume is memorized in the memory205, and then the audio signal temporarily stored in the audio decoder207is deleted and the test sound source data memorized in the audio data memory214is also deleted, with the result that the reproduction and output of the audio announcement from the speaker210is stopped (STEP812). Manipulation request data requesting the cancellation of the function of muting television audio is generated by the CPU204and is transmitted in the form of a wireless communication signal to the TV apparatus1(STEP813). In this way, the muting function is cancelled in the TV apparatus1, and this allows the speaker110to reproduce and output audio.

If it is found that a setting processing operation other than the volume setting processing operation of the remote controller2has been specified (“No” in STEP802), the manipulation portion201of the remote controller2is manipulated, and the specified setting processing operation is performed by the use of wireless communication between the remote controller2and the TV apparatus1(STEP814). This setting processing operation in STEP814is not particularly limited, and examples of the setting processing operation include processing operations for determining various setting factors for the TV apparatus1and the remote controller2.

Then, whether or not a wireless communication signal carrying both the status data indicating that the setting processing operation is completed in STEP814and the sound source data indicating that the processing operation is completed has been received by the wireless communication module202is checked by the CPU204(STEP815). If the wireless communication signal indicating that the setting processing operation is completed is found not to have been received (“No” in STEP815), the process again proceeds to STEP814, where the specified setting processing operation is performed.

If the wireless communication signal indicating that the setting processing operation is completed is found to have been received (“Yes” in STEP815), the sound source data derived from the received wireless communication signal is memorized in the audio data memory214, and then this sound source data is decoded by the audio decoder207(STEP816). The audio signal obtained by the decoding is converted into an analog signal by the DAC208, and is then amplified by the amplifier209, with the result that an audio announcement such as the voice “the processing has been completed” is reproduced and outputted from the speaker210(STEP817).

If this audio announcement from the speaker210is started, the CPU204controls the vibration unit215such that the vibration unit215starts a vibration operation (STEP818). If this vibration unit215starts vibrating, the CPU204checks whether or not the audio announcement currently being reproduced and outputted from the speaker210has been completed (STEP819). Thus, if the CPU204finds that the audio announcement currently being reproduced and outputted from the speaker210has been completed (“Yes” in STEP819), the CPU204stops the vibration of the vibration unit215(STEP820).

After, in STEP813, a wireless communication signal for canceling the function of muting television audio is transmitted to the TV apparatus1or after, in STEP820, the vibration of the vibration unit215is stopped, as in STEP215in the flow chart ofFIG. 2, the remote controller2enters the sleep state (STEP821).

The above description discusses the case where the operations of the remote controller2are performed sequentially based on the flow charts ofFIGS. 2,4,5,7and8. However, these operations based on the flows may be performed in parallel, and, while operations based on one of the flows are performed, an interrupt signal for performing operations based on another flow may be fed to the CPU204and the operations based on the flow specified by the interrupt signal may be performed.

(Various Types of Operation Processing by the TV Apparatus)

The various types of operation processing by the TV apparatus1in the remote control system where the TV apparatus1and the remote controller2are configured as described above will be described in detail below.

(1) Basic Operation

The operations of the UV apparatus1when power is turned on will first be described with reference to a flow chart shown inFIG. 9. If the CPU111first finds that a wireless communication signal from the remote controller2or a manipulation on the manipulation portion117shows that the power is requested to be turned on (“Yes” in STEP901), electric power is supplied to the blocks of the TV apparatus1from an unillustrated power supply, and thus the power is turned on (STEP902). In the TV apparatus1, when main power is on, electric power is assumed to be supplied to part of the CPU111, the wireless communication module115and the like

Here, for example, in STEP6in the basic operation of the remote controller2according to the flow chart ofFIG. 2, when a wireless communication signal transmitted from the wireless communication module202is received by the wireless communication module115, the CPU111finds the manipulation request data of the wireless communication signal. Then, the CPU111finds that the manipulation request data shows that the power to the TV apparatus1is requested to be turned on, and thus the power to the TV apparatus1is turned on. Alternatively, the CPU111finds that a manipulation is performed on the manipulation portion117and thus the power is requested to be turned on, and accordingly the power to the TV apparatus1is turned on.

Thereafter, status data indicating that the power has been turned on is generated by the CPU111, is encoded and modulated by the wireless communication module115and is then transmitted in the form of a wireless communication signal to the remote controller2(STEP903). If the power is turned on through the manipulation portion117, it is unnecessary to transmit to the remote controller2a wireless communication signal of the status data indicating that the power has been turned on.

If it is found that the power is not requested to be turned on (“No” in STEP901) or the wireless communication signal is transmitted in STEP903, whether or not the wireless communication module115receives a wireless communication signal requesting the sound source data is checked by the CPU111(STEP904). If the CPU111finds that the wireless communication signal of the manipulation request data requesting the sound source data is received (“Yes” in STEP904), the sound source data requested by the manipulation request data is read from the audio data memory114and is transmitted in the form of a wireless communication signal from the wireless communication module115to the remote controller2(STEP905).

Specifically, for example, if, in STEP10in the flow chart ofFIG. 2, the remote controller2requests that the sound source data for the voice “move the pointer” be transmitted, and then the CPU111finds this manipulation request data, the sound source data for the voice “move the pointer” is read from the audio data memory114. Then, this sound source data is encoded and demodulated by the wireless communication module115, is thereby converted into a wireless communication signal and is transmitted to the remote controller2.

If the request of the sound source data is not found (“No” in STEP904) or if the wireless communication signal is transmitted in STEP905, whether or not a wireless communication signal of audio data for recording has been received by the wireless communication module115is checked by the CPU111(STEP906). If it is found that the wireless communication signal of the audio data for recording has been received (“Yes” in STEP906), the audio data obtained from the wireless communication signal received by the wireless communication module115is memorized in the audio data memory114(STEP907).

Specifically, if, in STEPS708through715in the flow chart ofFIG. 7, the remote controller2transfers the audio data for recording that is inputted through the microphone211, the CPU111finds the transferred audio data for recording. Then, the received wireless communication signal is demodulated and thereafter the audio data for recording obtained by the decoding is memorized in the audio data memory114.

When the audio data for recording is recorded in this way, the audio data memorized in the audio data memory114and recorded by the recorder function of the remote controller2may be organized on a file-by-file basis such that a file is produced every day when recording is performed. When the storage capacity of the audio data memory114is so small that the audio data obtained from the received wireless communication signal cannot be memorized, a wireless communication signal carrying warning information may be transmitted to the remote controller2.

If it is found that the audio data for recording has not been received (“No” in STEP906) or if the audio data is memorized in the audio data memory114in STEP907, whether or not a wireless communication signal of manipulation request data indicating that the muting function is requested to be performed has been received by the wireless communication module115is checked by the CPU111(STEP908). If it is found that the muting function is requested to be performed (“Yes” in STEP908), audio is prevented, by preventing an audio signal from the decoder103from being fed to the amplifier109or by setting the amplification factor of the amplifier109at zero, from being outputted from the speaker110(STEP909).

Specifically, for example, if, in STEP513in the flow chart ofFIG. 5, the remote controller2requests that the audio be prevented from being outputted from the speaker110, it is found that the manipulation request data obtained from the wireless communication signal received by the wireless communication module115shows that the muting function is requested to be performed. Then, audio is prevented, by preventing the audio signal from the decoder103from being fed to the amplifier109or by setting the amplification factor of the amplifier109at zero, from being reproduced and outputted from the speaker110. The muting function may be performed by a manipulation on the manipulation portion117.

If it is found that the muting function is not requested to be performed (“No” in STEP908) or if the muting function is performed in STEP909, whether or not a wireless communication signal of manipulation request data requesting the transmission of audio data that is reproduced by the speaker210in the remote controller2has been received by the wireless communication module115is checked by the CPU111(STEP910). If the CPU111finds that the audio data of the audio signal obtained by the decoder103is requested to be transmitted (“Yes” in STEP910), the audio signal from the decoder103is encoded by the audio encoder113and is temporarily memorized in the audio data memory114(STEP911).

Thereafter, the audio data memorized in the audio data memory114in STEP911is read, and is transmitted in the form of a wireless communication signal to the remote controller2by the wireless communication module115(STEP912). Here, a video signal corresponding to the audio signal encoded in STEP911is temporarily memorized, from the decoder103, in the frame memory107, and is reproduced and displayed on the display105in synchronization with the timing with which audio is outputted by the remote controller2(STEP913). The operation performed in STEP913is referred to as an “image synchronization delay processing operation”, which will be described later.

Specifically, for example, if, in STEP508in the flow chart ofFIG. 5, the remote controller2requests that audio corresponding to the video of the sub screen601be transmitted, the audio data of an audio signal corresponding to the video of the sub screen601reproduced and displayed on the display105is generated from the manipulation request data obtained from the wireless communication signal received by the wireless communication module115, and is transmitted to the remote controller2. The timing with which the video signal is reproduced and outputted on the sub screen601is delayed by the use of the frame memory107such that a video scene reproduced and outputted on the sub screen601is synchronized with the output of the audio from the remote controller2.

If it is found that the audio data to be reproduced by the speaker210in the remote controller2is not requested to be transmitted (“No” in STEP910) or if the image synchronization delay processing operation is performed in STEP913, whether or not a wireless communication signal of manipulation request data indicating that the muting function is requested to be cancelled has been received by the wireless communication module115is checked by the CPU111(STEP914). If it is found that the muting function is requested to be cancelled (“Yes” in STEP914), the speaker110is brought to a state where audio can be outputted, by permitting the decoder103to feed an audio signal to the amplifier109or by returning the amplification factor of the amplifier109to the original value.

Specifically, for example, if, in STEP515in the flow chart ofFIG. 5, the remote controller2requests that the output of audio from the speaker110be restarted, it is found that manipulation request data obtained from a wireless communication signal received by the wireless communication module115shows that the muting function is requested to be cancelled. Then, by permitting the decoder103to feed an audio signal to the amplifier109or by returning the amplification factor of the amplifier109to that before the muting function is performed, audio is prevented from being reproduced and outputted from the speaker110. The cancellation of the muting function may also be performed by a manipulation on the manipulation portion117.

If it is found that the muting function is not requested to be cancelled (“No” in STEP914) or if the muting function is cancelled in STEP915, whether or not the search for the remote controller2(hereinafter referred to as “a missing remote controller search manipulation”) has been requested by a manipulation on the manipulation portion117is checked by the CPU111(STEP916). If the missing remote controller search manipulation is requested through the manipulation portion117, sound source data used when the remote controller2outputs sound to notify the user of the place where it is located is read from the audio data memory114and is transmitted in the form of a wireless communication signal from the wireless communication module115(STEP917). The operation of the remote controller2when this missing remote controller search manipulation is performed will be described later.

Then, it is found that the missing remote controller search manipulation is requested (“No” in STEP916) or if the wireless communication signal of the sound source data is transmitted in STEP917, whether or not the power to the TV apparatus1has been requested to be turned off through the remote controller2or the manipulation portion117is checked by the CPU111(STEP918). If the power is not requested to be turned off (“No” in STEP918), the process proceeds to STEP901, where the operations in STEP901and the following steps are repeated. If the power is requested to be turned off (“Yes” in STEP918), the power is only supplied to blocks that detect whether or not the power is requested to be turned on, and the supply of the power to the other blocks in the TV apparatus1is stopped (STEP919).

The following steps are not shown in the flow chart ofFIG. 9. If in the remote controller2, an item specifying manipulation is performed on the manipulation portion201in STEP3in the flow chart ofFIG. 2, and the wireless communication signal is transmitted in STEP4, the TV apparatus1receiving this wireless communication signal may transmit to the remote controller2, if the power to the TV apparatus1is on as in STEP902and the following steps, a wireless communication signal serving as the same response signal as in STEP903. If the manipulation portion117or the remote controller2requests that an OSD image be displayed on the display105of GUI, the requested OSD image is read from the image memorizing portion106and is reproduced and displayed on the display105.

If the missing remote controller search manipulation is requested and the wireless communication signal of the sound source data is transmitted in STEP917, this wireless communication signal of the sound source data is transmitted repeatedly until a response signal indicating the wireless communication signal is received by the remote controller2is transmitted in the form of a wireless communication signal from the remote controller2and then it is received by the wireless communication module115. This allows the remote controller2being located by the missing remote controller search manipulation to reliably receive the wireless communication signal transmitted by the TV apparatus1to be used in the missing remote controller search manipulation

(2) Television Image Synchronization Delay Processing Operation

The image synchronization delay processing operation in STEP913in the basic operation according to the flow chart ofFIG. 9will now be described with reference to a flow chart shown inFIG. 10. As described previously, when the audio data encoded by the audio encoder113is transmitted in the form of a wireless communication signal, the video based on the video signal corresponding to the audio signal that has not been encoded by the audio encoder113is reproduced and displayed on the display105such that it is so delayed as to synchronize with the audio output of the remote controller2.

Here, the CPU111first switches from a state in which the video signal is fed from the decoder103to the display control portion104to a state in which the video signal is fed from the decoder103to the frame memory107, where it is temporarily memorized, and is then fed to the display control portion104(STEP1001). Thus, the video signal outputted from the decoder103is fed to the frame memory107, and a temporal recording operation is started (STEP1002).

Then, the CPU111first calculates a period Ta necessary to perform the following: the audio signal fed from the decoder103is encoded by the audio encoder113, is then temporarily memorized in the audio data memory114, is then read by the wireless communication module115and is converted into a wireless communication signal (STEP1003). The CPU111then predicts a period Tb necessary to transmit the wireless communication signal generated by the wireless communication module115to the remote controller2(STEP1004).

With respect to the period Tb calculated in STEP1004, for example, when the wireless communication signal transmitted from the remote controller2is received by the wireless communication module115, from a time ta when the wireless communication signal is received and a time stamp given by the remote controller2to the wireless communication signal and the like, a time tb when the wireless communication signal is transmitted from the remote controller2is determined and is memorized in the memory112. Then, when the calculation is performed in STEP1004, the CPU111reads the times ta and tb recorded in the memory112and performs a subtraction on them, and thereby predicts the period Tb necessary for the transmission to the remote controller2.

Moreover, the result obtained by calculating a period Tc from when the wireless communication signal is received by the wireless communication module202and is then decoded by the audio decoder207through the audio data memory214to when audio is reproduced and outputted by the speaker210is obtained by reception of the wireless communication signal transmitted from the remote controller2(STEP1005). This period Tc is calculated by the CPU204in the remote controller2, and the resulting data, namely, the calculation result is transmitted, from the wireless communication module202, in the form of the wireless communication signal transmitted from the remote controller2. Thus, in the TV apparatus1, such a signal is received by the wireless communication module115and is fed to the CPU111, where the period Tc is found.

The periods Ta to Tc required for the types of processing are calculated in this way, and then the CPU111sums these periods Ta to Tc to determine a delay period Td (=Ta+Tb+Tc) from when the audio signal is obtained by the decoder103to when it is outputted in the form of audio (STEP1006). Then, the CPU111determines, from this delay period Td, a time difference between when the video signal obtained by the decoder103is stored in the frame memory107and when it is read by the display control portion104and is reproduced and outputted on the display105(STEP1007).

The video signal recorded in the frame memory107from the decoder103is so read by the display control portion104as to be delayed by the time difference determined in STEP1007, and thus a video scene synchronized with the audio reproduced and outputted by the remote controller2is reproduced and displayed on the display105(STEP1008). When, as described above, the video corresponding to the audio reproduced and outputted by the speaker210in the remote controller2is so reproduced and outputted on the display105as to be delayed more than when it is decoded by the decoder103, whether or not the transmission of the audio signal from decoder103is requested to be stopped by the remote controller2is checked (STEP1009).

Specifically, for example, if, in the remote controller2, the transmission of the audio data is requested to be stopped in STEP514in the flow chart ofFIG. 5, whether or not the wireless communication signal requesting the stop of the transmission of the audio data is received by the wireless communication module115is checked in STEP1009. Here, if the transmission of the audio signal from decoder103is not requested to be stopped (“No” in STEP1009), the process proceeds to STEP1008, where the video displayed on the display105is delayed based on the calculated delay period.

Then, if it is found that the transmission of the audio signal from decoder103is requested to be stopped (“Yes” in STEP1009), the feed of the video signal to the display control portion104through the frame memory107is stopped, and the video signal is fed to the display control portion104directly from the decoder103(STEP1010). When a feed path from the display control portion104to the decoder103is switched, it is alternatively possible to delay the audio signal from the decoder103by the use of the audio data memory114or the like and then vary the times when the audio and video signals are read to gradually eliminate the delays of the audio and video signals. Here, when the delays are eliminated, the audio and video signals from the decoder103are directly fed to the DAC108and the display control portion104, respectively.

(Processing Operations on the Remote Controller for the Missing Remote Controller Search Manipulation)

The operations on the remote controller2for the missing remote controller search manipulation in the remote control system composed of the TV apparatus1and the remote controller2as described above will be described in detail below with reference to a flow chart ofFIG. 11. Specifically, the operations on the remote controller2when the missing remote controller search manipulation is requested by a manipulation on the manipulation portion117in the TV apparatus1will be described below.

When, as described above, in the TV apparatus1, the operation in STEP917in the flow chart ofFIG. 9is performed and the wireless communication signal of the sound source data used for the missing remote controller search manipulation is transmitted, this wireless communication signal is received by the wireless communication model202in the remote controller2. When the watchdog203finds that the wireless communication signal from the TV apparatus1has been received (STEP1101), a signal is fed to the CPU204from the watchdog203, and thus the sleep state of the remote controller2is exited (STEP1102). Specifically, the power supply portion206is so controlled by the CPU204as to supply power required for the speaker210to output audio, with the result that the sleep state is changed to the start-up state.

In the remote controller2, which has changed its state to the start-up state, the wireless communication module202performs a reception operation to receive the wireless communication signal from the TV apparatus1and acquires, from the received wireless communication signal, the sound source data for the missing remote controller search manipulation (STEP1103). When the wireless communication signal from the TV apparatus1is successfully received in STEP1103in this way, the CPU204generates a response signal for notifying the TV apparatus1of the fact that it has been successfully received, and the response signal in the form of a wireless communication signal is transmitted from the wireless communication module202to the TV apparatus1(STEP1104).

Thereafter, when the sound source data obtained in STEP1103is fed to and memorized in the audio data memory214(STEP1105), the sound source data memorized in the audio data memory214is read by the audio decoder207and is encoded by an encoding method such as an ADPCM method (STEP1106). In order for an audio announcement corresponding to the sound source data for the missing remote controller search manipulation to be reproduced and outputted repeatedly until the user finds the remote controller2and manipulates it, a setting is made such that such reproduction is repeatedly performed (STEP1107).

Specifically, in STEP1107, as in STEP807in the flow chart ofFIG. 8, an audio signal obtained by decoding the sound source data for the missing remote controller search manipulation is temporarily held in the audio decoder207, and thus the setting is made such that such reproduction is repeatedly performed. In order for the audio announcement to be reproduced and outputted repeatedly, it is alternatively possible to read, from the audio data memory214, the sound source data for the missing remote controller search manipulation and decode it every time the audio decoder207completes outputting the audio announcement.

Moreover, by, for example, reading, from the memory205, an audio code to maximize the volume and then maximizing the amplification factor of the amplifier209with the CPU204, the volume of audio reproduced and outputted from the speaker210is so set as to be maximized (STEP1108). When, as described above, such settings for repeatedly outputting the audio announcement corresponding to the sound source data for the missing remote controller search manipulation and for maximizing the volume are made, the audio signal decoded by the audio decoder207is converted into an analog signal by the DAC208and the audio announcement corresponding to the sound source data for the missing remote controller search manipulation is reproduced and outputted from the speaker210(STEP1109).

If the reproduction and output of the audio announcement is started, the CPU204checks whether or not a predetermined period T8has elapsed since the start of the reproduction and output of the audio announcement (STEP1110). If the predetermined period T8has not elapsed (“No” in STEP1110), the CPU204checks whether or not the manipulation portion201has been manipulated (STEP1111). If it is found that the manipulation portion201has not been manipulated (“No” in STEP1111), the process proceeds to STEP1110, where whether or not the predetermined period T8has elapsed is checked. In this way, the CPU204checks whether or not the predetermined period T8has elapsed since the start of the audio announcement and whether or not the manipulation portion201in the remote controller2has been manipulated.

Then, if it is found that the predetermined period T8has elapsed since the start of the announcement (“Yes” in STEP1110) or that the manipulation portion201has been manipulated (“Yes” in STEP1111), the audio signal temporarily stored in the audio decoder207is deleted and the sound source data memorized in the audio data memory214and used for the missing remote controller search manipulation is also deleted, with the result that the reproduction and output of the audio announcement from the speaker210is stopped (STEP1112).

If the reproduction and output of the audio announcement is stopped, the CPU204checks whether or not a predetermined period T9has elapsed since the stop of the audio announcement (STEP1113). If it is found that the predetermined period T9has elapsed since the stop of the audio announcement (“Yes” in STEP1113), as in STEP25in the flow chart ofFIG. 2, the remote controller2is changed to the sleep state (STEP1114).

If the volume is set at the maximum volume in STEP1108, the original volume code may be memorized in the memory205. In this way, when the reproduction and output of the audio announcement corresponding to the sound source data for the missing remote controller search manipulation is stopped in STEP1112, it is possible to return, by setting the amplification factor of the amplifier209or the like according to the original audio code memorized in the memory205, the volume from the speaker210to the original volume. When the manipulation portion117in the TV apparatus1is manipulated and thus the missing remote controller search manipulation is requested to be stopped, the reproduction and output of the audio announcement in the remote controller2may be stopped.

Industrial Applicability

The present invention can be applied not only to the above-described remote control system for the TV apparatus but also to a remote control system for an electronic device incorporating a display that allows GUI display.