# Patent

## Title
Communications terminal device allowing content reception and voice communication

## Abstract

In a terminal, a content reproduction section reproduces a video signal and an audio signal from a received transport stream. A telephony processing section performs processing necessary for voice communication. A status detection section detects a time point at which the status of voice communication changes. A control section writes the transport stream received by the content reproduction section in a content storage section when the status detection section detects start of voice communication, and reads and sends the transport stream stored in the content storage section to the content reproduction section according to a predetermined timing. The content reproduction section reproduces a video signal and an audio signal from the transport stream read by the control section.

## Background
BACKGROUND OF THE INVENTION
1. Field of the Invention
The present invention relates to communications terminal devices, and more particularly, to a communications terminal device having a content reception function and a voice communication function.
2. Description of the Background Art
Terrestrial digital broadcasting is scheduled to commence in Japan first in the three biggest metropolitan areas in 2003 and then nationwide in 2006. A feature of terrestrial digital broadcasting is that mobile reception of contents is possible. As for mobile communications, the third-generation cellular phone service started in 2001, enabling distribution of moving pictures and a portable videophone. Under the present situation as described above, there has been recently announced a concept of a communications terminal device having both the content reception function and the voice communication function. However, when a voice call arrives while viewing a content with such a communications terminal device, the user tends to choose to answer the call rather than continuing viewing the content. In the opposite case, that is, if a content that the user desires to view has started while the user is engaged in voice communication using a mobile communications terminal device, the user tends to continue the voice communication.
There is known in the art a conventional television which receives a video signal externally broadcast on the channel selected by the viewer, reproduces the received video signal, and outputs a video represented by the received video signal. The conventional television includes a built-in modem which outputs a status signal when a fixed telephone receives a call during the reception of the video signal. In response to the status signal, the conventional television begins recording of the currently receiving video signal in a storage device built therein (that is, performs video recording). After the voice communication is finished, the conventional television reproduces the video signal recorded in the storage device. Thus, the viewer can view the video missed due to the voice communication.
The conceptual communications terminal device has a problem that the user is not allowed to view the content at least until the voice communication is finished. As another problem, the conventional television described above needs to have a storage device with a large capacity capable of storing a long content. However, the communications terminal device described above, which is a mobile unit, is allowed to include only a small-capacity storage device and thus cannot store a long content therein. In view of this, it is difficult to implement the technology developed for televisions as described above for a mobile communications terminal device without substantial modifications.
SUMMARY OF THE INVENTION
Therefore, an object of the present invention is to provide a communications terminal device capable of outputting a portion of a content missed by the user due to voice communication at a time shifted from the actual broadcast time.
Another object of the present invention is to provide a communications terminal device capable of recording/reproducing a portion of a content missed by the user due to voice communication by a technique suitable for mobile units.
The present invention has the following features to attain the objects mentioned above.
A first aspect of the present invention is directed to a communications terminal device including: a reproduction section operable to receive and reproduce a content transmitted from an external source; a telephony processing section operable to receive and reproduce at least voice of a party on the other end of voice communication; a status detection section operable to detect a status change of voice communication; a storage section operable to store the content received by the reproduction section; a write section operable to write the content received by the reproduction section in the storage section while the status detection section detects a status change of voice communication; and a read section operable to read the content stored in the storage section. The reproduction section is further operable to reproduce the content read by the read section. Typically, the reproduction section receives a program composed of a video and audio from a remote broadcast station as a content. As described above, the communications terminal device stores the received content in the storage section while the user is engaged in voice communication, and reads and reproduces the stored content after the voice communication is finished. Thus, the communications terminal device can provide the user with the portion of the content the user failed to view due to the voice communication.
Preferably, the read section is operable to start read of the content stored in the storage section while the status detection section detects a next status change of voice communication. By this processing, reproduction of the content automatically starts. It is therefore possible to provide a communications terminal device having more enhanced operability.
Typically, the status detection section is operable to detect an incoming call at the telephony processing section as a start point of voice communication, and detect that the telephony processing section has disconnected voice communication. Alternatively, the status detection section is operable to detect that the telephony processing section has entered an off-hook state as a start point of voice communication, and detect that the telephony processing section has entered an on-hook state as an end point of voice communication. In this way, the status can be detected using the voice communications function originally possessed by the communications terminal device. It is therefore possible to reduce the number of components of the communications terminal device and minimize the fabrication cost.
Furthermore, the telephony processing section is operable to receive and reproduce an image of the party on the other end of voice communication.
Alternatively, the reproduction section is operable to reproduce the content read by the read section at n times speed (n is a positive number satisfying n>1), and also is operable to receive and reproduce the content transmitted from the external source when the read by the read section is completed. The communications terminal device reproduces the receiving content once substantially no data is left in the storage section. Therefore, it is unnecessary to store all the content received after the start of voice communication in the storage section. This enables recording/reproduction suitable for a communications terminal device allowed to include only a small-capacity memory.
The communications terminal device may further include: an image generation section operable to generate image information relating to voice communication; and an image combining section operable to generate combined image information by combining the content received by the reproduction section and the image information generated by the image generation section while the status detection section detects a status change of voice communication. With these components, the user can view the content even during voice communication. It is therefore possible to realize a communications terminal device having further enhanced operability.
The reproduction section is further operable to receive text data relating to the content, and the image combining section is operable to generate the combined image information to which the received text data is additionally included. The user can view the text data even during voice communication. It is therefore possible to realize a communications terminal device having further enhanced operability.
The image combining section is operable to generate the combined image information to which an image of the party on the other end of the voice communication is additionally included. Furthermore, when the reproduction section can capture an image of the user, the image combining section can generate the combined image information to which the captured image of the user is additionally included.
When the reproduction section can reproduce at least audio constituting the received content, the communications terminal device may further include: a mute detection section operable to detect a mute time period of voice communication; and a voice switch section operable to output the audio reproduced by the reproduction section during the mute time period detected by the mute detection section. The voice switch section can further output a voice signal reproduced by the telephony processing section when the mute detection section detects no mute time period. This enables the user to hear audio constituting the content even during voice communication. It is therefore possible to provide a communications terminal device having further enhanced operability.
The communications terminal device further includes first and second speakers operable to output the audio reproduced by the reproduction section and the voice reproduced by the telephony processing section while a status change of voice communication is detected by the status detection section. This enables the user to hear audio of the content during voice communication.
The communications terminal device further includes a start detection section operable to detect a predetermined content transmission start time. The write section can further store the content received by the reproduction section while a transmission status change is detected by the start detection section. Thus, the communications terminal device can provide the user with the portion of the content the user failed to view and hear due to voice communication.
For time-shifted reproduction, the read section can further read the content stored in the storage section from a head thereof during the progress of writing of the content in the storage section by the write section. Thus, the communications terminal device can provide the user with the portion of the content the user failed to view and hear due to voice communication.
The communications terminal device further includes: an end time determination section operable to determine an end time of the content received by the reproduction section and currently being written in the storage section; and a write terminating section operable to terminate the write of the content in the storage section when the end time determination section determines that the end time has passed. With the write terminating section, the write of the object content in the storage section can be terminated once the content are finished, even during voice communication. This enables recording/reproduction suitable for a communications terminal device allowed to include only a small-capacity memory.
The communications terminal device further includes a remaining capacity detection section operable to detect the remaining recording capacity of the storage section. The write section can further determine a bit rate based on the remaining capacity detected by the remaining capacity detection section, and write the content received by the reproduction section based on the determined bit rate. As described above, the bit rate of the content can be controlled according to the remaining capacity of the storage section. This enables recording/reproduction suitable for a communications terminal device allowed to include only a small-capacity memory.
A second aspect of the present invention is a computer program for providing a function of broadcast reception and a function of voice communication to a computer, including the steps of: receiving and reproducing a content transmitted from an external source; receiving and reproducing at least voice of a party on the other end of voice communication; detecting a status change time point of the voice communication; writing the content received in the step of receiving and reproducing a content while a status change of voice communication is detected in the step of detecting; and reading the content written in the step of writing. The step of receiving and reproducing a content can further reproduce the content read in the step of reading. Typically, the computer program is recorded in a recording medium.
These and other objects, features, aspects and advantages of the present invention will become more apparent from the following detailed description of the present invention when taken in conjunction with the accompanying drawings.



BRIEF DESCRIPTION OF THE DRAWINGS
FIG. 1 is a block diagram showing the construction of a terminal device E1 of an embodiment of the present invention.
FIG. 2 is a timing chart showing an outline of an operation of the terminal device E1 of FIG. 1.
FIG. 3 is a flowchart showing a detailed operation of the terminal device E1 of FIG. 1.
FIG. 4 is a block diagram showing the construction of a terminal device E2 that is a first variant of the terminal device E1 of FIG. 1.
FIG. 5 is a timing chart showing an outline of an operation of the terminal device E2 of FIG. 4.
FIG. 6 is a flowchart showing a detailed operation of the terminal device E2 of FIG. 4.
FIG. 7 is a block diagram showing the construction of a terminal device E3 that is a second variant of the terminal device E1 of FIG. 1.
FIG. 8 is a timing chart showing an outline of an operation of the terminal device E3 of FIG. 7.
FIG. 9 is a flowchart showing a detailed operation of the terminal device E3 of FIG. 7.
FIG. 10 is a view showing a first example of a combined image signal SLM generated by an image combining section 104 in FIG. 7.
FIG. 11 is a view showing a second example of the combined image signal SLM generated by the image combining section 104 in FIG. 7.
FIG. 12 is a view showing a third example of the combined image signal SLM generated by the image combining section 104 in FIG. 7.
FIG. 13 is a block diagram showing the construction of a terminal device E4 that is a third variant of the terminal device E1 of FIG. 1.
FIG. 14 is a timing chart showing an outline of an operation of the terminal device E4 of FIG. 13.
FIG. 15 is a flowchart showing a detailed operation of the terminal device E4 of FIG. 13.
FIG. 16 is a block diagram showing the construction of a terminal device E5 that is a fourth variant of the terminal device E1 of FIG. 1.
FIG. 17 is a timing chart showing an outline of an operation of the terminal device E5 of FIG. 16.
FIG. 18 is a flowchart showing a detailed operation of the terminal device E5 of FIG. 16.
FIG. 19 is a block diagram showing the construction of a terminal device E6 that is a fifth variant of the terminal device E1 of FIG. 1.
FIG. 20 is a timing chart showing an outline of an operation of the terminal device E6 of FIG. 19.
FIG. 21 is a flowchart showing a detailed operation of the terminal device E6 of FIG. 19.
FIG. 22 is a block diagram showing the construction of a terminal device E7 that is a sixth variant of the terminal device E1 of FIG. 1.
FIG. 23 is a timing chart showing an outline of an operation of the terminal device E7 of FIG. 22.
FIG. 24 is a flowchart showing the detailed operation of the terminal device E7 of FIG. 22.
FIG. 25 is a block diagram showing the construction of a terminal device E8 that is a seventh variant of the terminal device E1 of FIG. 1.
FIG. 26 is a timing chart showing an outline of an operation of the terminal device E8 of FIG. 25.
FIG. 27 is a flowchart showing a detailed operation of the terminal device E8 of FIG. 25.



DESCRIPTION OF THE PREFERRED EMBODIMENTS
FIG. 1 is a block diagram showing the construction of a mobile communications terminal device (hereinafter, referred to as a terminal device for simplification) E1 of an embodiment of the present invention. In FIG. 1, the terminal device E1 includes a content reproduction section 1, a telephony processing section 2, an image switch section 3, a display device 4, a voice switch section 5, a speaker 6, a status detection section 7, a control section 8, a content storage section 9, and an input device 10.
The content reproduction section 1 receives a transport stream STT which is composed of at least one channel and broadcast from a terrestrial digital broadcast station 101, and reproduces a content from the received transport stream STT. In this embodiment, the content are assumed to be a TV program broadcast in a scheduled time frame according to a timetable made up by the broadcasting provider, for example. The TV program is essentially composed of a video represented by a video signal SLV and audio represented by an audio signal SLA. The video signal SLV and the audio signal SLA are encoded at the broadcast station 101 according to Moving Picture Experts Group (MPEG). The resultant encoded video signal CSLV and encoded audio signal CSLA are multiplexed for generating the transport stream STT. The content reproduction section 1 is also made operable to reproduce the video signal SLV and the audio signal SLA from the transport stream STT read from the content storage section 9 (described below) in an event that voice communication is started during reception/reproduction of contents. To implement the reception/reproduction of contents as described above, the content reproduction section 1 includes an antenna 11, a tuner 12, a TS switch section 13, a demultiplexer 14, a video decoder 15, and an audio decoder 16.
The antenna 11 receives transport streams STT broadcast from a plurality of broadcast stations 101 (a single station is shown in FIG. 1), and outputs the received streams to the tuner 12. The tuner 12 selects a transport stream STT transmitted on the channel designated by the user among ones transmitted on the channels receivable by the antenna 11, and outputs the selected transport stream STT to both the TS switch section 13 and the control section 8. The TS switch section 13 outputs the transport stream STT sent from the tuner 12 to the demultiplexer 14. The TS switch section 13 also receives the transport stream STT read from the content storage section 9 by the control section 8, and outputs the received transport stream STT to the demultiplexer 14. The TS switch section 13 switches these two input lines in accordance with a control signal CSc sent from the control section 8. The demultiplexer 14 demultiplexes the transport stream STT output from the TS switch section 13 into the encoded video signal CSLV and the encoded audio signal CSLA, which are sent to the video decoder 15 and the audio decoder 16, respectively. The video decoder 15 decodes the encoded video signal CSLV received from the demultiplexer 14 in accordance with MPEG, and reproduces the video signal SLV representing a video constituting the content. The reproduced video signal SLV is output to the image switch section 3. The audio decoder 16 decodes the encoded audio signal CSLA received from the demultiplexer 14 in accordance with MPEG, and reproduces the audio signal SLA representing audio synchronizing with the video and constituting the content. There produced audio signal SLA is output to the voice switch section 5.
The telephony processing section 2 communicates with a base station 102 included in a mobile communication system, and receives/sends a multiplexed signal SLS from/to the base station 102. The multiplexed signal SLS, multiplexed and encoded according to a multiplexing scheme and a voice encoding scheme adopted by the mobile communication system, includes at least an encoded voice signal CSLS1 representing the speech of the party with which the user speaks using the terminal device E1 and an encoded voice signal CSLS2 representing the speech of the user. To implement the voice communication described above, the telephony processing section 2 typically includes an antenna 21, a wireless communications part 22, a voice decoder 23, a voice input part 24, and a voice encoder 25.
The antenna 21 receives the multiplexed signal SLS sent from the base station 102. The wireless communications part 22, as a demultiplexer, demultiplexes the multiplexed signal SLS to obtain the encoded voice signal CSLS1, and outputs the demultiplexed signal to the voice decoder 23. The voice decoder 23 decodes the encoded voice signal CSLS1 output from the wireless communications part 22 according to the voice encoding scheme described above, and outputs the resultant voice signal SLS1 to the voice switch section 5. The voice input part 24 generates a voice signal SLS2 representing the speech of the user, and outputs the generated signal to the voice encoder 25. The voice encoder 25 encodes the voice signal SLS2 received from the voice input part 24 according to the voice encoding scheme described above, and outputs the resultant encoded voice signal CSLS2 to the wireless communications part 22. The wireless communications part 22, as a multiplexer, multiplexes the encoded voice signal CSLS2 received from the voice encoder 25 for generating the multiplexed signal SLS, and outputs the generated signal SLS to the antenna 21. The antenna 21 sends the multiplexed signal SLS received from the wireless communications part 22 to the base station 102.
The image switch section 3 outputs the video signal SLV received from the video decoder 15 to the display device 4. The image switch section 3 also receives an image signal SLI, which is used during voice communication typically for displaying the current time, the radio-wave reception state, and the amount of remaining battery time. The image signal SLI is generated by the control section 8. The image switch section 3 switches between the output of the input video signal SLV and the output of the input image signal SLI in accordance with the control signal CSa or CSb sent from the control section 8. The display device 4 displays a video or an image in accordance with the video signal SLV or the image signal SLI output from the image switch section 3.
The voice switch section 5 outputs the audio signal SLA sent from the audio decoder 16 to the speaker 6. The voice switch section 5 also outputs the voice signal SLS1 sent from the voice decoder 23 to the speaker 6. The voice switch section 5 switches between the output of the input audio signal SLA and the output of the input voice signal SLS1 in accordance with the control signal CSa or CSb sent from the control section 8. The speaker 6 outputs the audio synchronizing with the video or the speech of the party on the other end of the voice communication.
In the mobile communication system, in addition to the multiplexed signal SLS described above, various control signals CSM, such as those indicating an incoming call and disconnection of voice communication, are exchanged between the terminal device E1 and the base station 102. The wireless communications part 22 sends and receives such control signals CSM via the antenna 21. Such control signals CSM, received or to be sent, are also supplied to the status detection section 7 from the wireless communications part 22. The status detection section 7 decodes the control signals CSM sent from the wireless communications part 22, and outputs a signal CSST (hereinafter, referred to as status notification) indicating status changes of voice communication, which are typically an incoming call or disconnection of the voice communication, to the control section 8.
To control the components described above, the control section 8 includes a program memory 81, a processor 82, and a working area 83. The program memory 81 stores an operating system (OS), computer programs for receiving/reproducing of contents, and computer programs for voice communication processing. In this embodiment, these programs are collectively referred to as a program CP1 for the sake of convenience. The processor 82 executes the program CP1, using the working area 83.
The content storage section 9 stores the transport stream STT transferred from the tuner 12 under control of the control section 8. The input device 10 outputs, to the control section 8, a signal SLP (hereinafter, referred to as start instruction) for instructing read of the transport stream STT stored in the content storage section 9 in response to an input from the user.
Next, an operation of the terminal device E1 described above is outlined with reference to FIG. 2. In FIG. 2, assuming that a call arrives when the terminal device E1 receives/reproduces the transport stream STT (that is, content) at time t0, the user is prevented from viewing the content from time t0 until the voice communication is finished. The terminal device E1 therefore stores the transport stream STT received during the voice communication in the content storage section 9 while the user is prevented from viewing the content. Assuming that the voice communication is finished and the terminal device E1 disconnects it at time t1, the terminal device E1 restarts the reception/reproduction of the transport stream STT at time t1, and the reception/reproduction thereof is finished at time t2. After time t2, the start instruction SLP described above is generated. In response to the start instruction SLP, the terminal device E1 reads the transport stream STT stored in the content storage section 9, and reproduces the transport stream STT. In this way, the user can view the portion of the content missed due to the voice communication.
The operation outlined above with reference to FIG. 2 is described in detail with reference to the flowchart of FIG. 3. In FIG. 3, the processor 82 executes the program for receiving/reproducing of contents, which is included in the program CP1. During the execution of the program CP1, if the user designates a channel in order to view a desired content (hereinafter, referred to as an object content), the following setting is performed by the processor 82. That is, the designated channel to be received by the tuner 12 is set, the TS switch section 13 is set to the state ready to receive the output of the tuner 12, the image switch section 3 is set to the state ready to receive the output of the video decoder 15, and the voice switch section 5 is set to the state ready to receive the output of the audio decoder 16. After this setting, the terminal device E1 reproduces the video signal SLV and the audio signal SLA from the received transport stream STT, and outputs a video and audio synchronizing with the video (step S1). More specifically, the tuner 12 selects a transport stream STT transmitted via the set channel among the transport streams STT output from the antenna 11, and outputs the selected transport stream STT to the TS switch section 13. The TS switch section 13 outputs the input transport stream STT to the demultiplexer 14. The demultiplexer 14 demultiplexes the input transport stream STT, and outputs the resultant encoded video signal CSLV and encoded audio signal CSLA to the video decoder 15 and the audio decoder 16, respectively. The video decoder 15 decodes the input encoded video signal CSLV, and outputs the resultant video signal SLV to the display device 4 via the image switch section 3. The audio decoder 16 decodes the input encoded audio signal CSLA, and outputs the resultant audio signal SLA to the speaker 6 via the voice switch section 5. By the processing described above, a video constituting the object content is displayed on the display device 4 while audio synchronizing with the displayed video is output from the speaker 6. As is found from FIG. 1, the output transport stream STT is also sent to the control section 8 from the tuner 12. In step S1, however, the control section 8 preferably abandons the input transport stream STT without transferring it to the content storage section 9. A switch (not shown) may be provided somewhere between the tuner 12 and the TS switch section 13 so as to block the transport stream STT output from the tuner 12 from being input into the control section 8 in step S1.
Subsequent to step S1, the processor 82 determines whether or not status notification CSST indicating a status change of the voice communication, that is, an incoming call, has been received from the status detection section 7 (step S2). If not received, indicating no voice communication processing is necessary, execution of step S1 is repeated. If status notification CSST indicating an incoming call has been received, the processor 82 first generates the control signal CSa, and sends the signal to the image switch section 3 for switching between the two input lines and the voice switch section 5 for switching between the two input lines (step S3). With this control signal CSa, the image switch section 3 is set to the state ready to receive the output of the control section 8, and the voice switch section 5 is set to the state ready to receive the output of the voice decoder 23. The processor 82 then starts execution of the program for voice communication processing included in the program CP1. The terminal device E1 exchanges the multiplexed signal SLS with the base station 102 for voice communication, reproduces the voice signal SLS1 included in the multiplexed signal SLS, and outputs the speech of the caller. The terminal device E1 also generates the encoded voice signal CSLS2 from the voice signal SLS2 representing the speech of the user, multiplexes the encoded voice signal CSLS2, and sends the resultant multiplexed signal SLS to the base station 102. That is, the terminal device E1 performs voice communication processing (step S4). More specifically, the wireless communications part 22 switches its function between that of a demultiplexer and that of a multiplexer. The wireless communications part 22, as a demultiplexer, demultiplexes the multiplexed signal SLS output from the antenna 21 to obtain the encoded voice signal CSLS1, and outputs the encoded voice signal CSLS1 to the voice decoder 23. The voice decoder 23 decodes the received encoded voice signal CSLS1, and outputs the decoded voice signal SLS1 to the speaker 6 via the voice switch section 5. By the processing described above, the speech of the caller is output from the speaker 6.
The voice input part 24 generates the voice signal SLS2 representing the speech of the user, and outputs the voice signal SLS2 to the voice encoder 25. The voice encoder 25 encodes the input voice signal SLS2, and outputs the resultant encoded voice signal CSLS2 to the wireless communications part 22. The wireless communications part 22, as a multiplexer, multiplexes the input encoded voice signal CSLS2, and sends the multiplexed signal SLS to the base station 102. The processor 82 also generates the image signal SLI on the working area 83 if required, and sends the generated signal SLI to the display device 4 via the image switch section 3. By this processing, an image represented by the image signal SLI is displayed on the display device 4.
Subsequent to step S4 described above, the transport stream STT output from the tuner 12 is stored in the content storage section 9 under control of the processor 82 (step S5). After storing of the transport stream STT, the processor 82 determines whether or not status notification CSST indicating a next status change of the voice communication, that is, disconnection of the voice communication, has been received from the status detection section 7 (step S6). If not received, indicating that no restart of reception/reproduction of the content is necessary, steps S4 and S5 are executed until disconnection of the voice communication is detected. If status notification CSST indicating disconnection of the voice communication has been received, this means that time t1 (see FIG. 2) has been detected. Therefore, in order to restart reception/reproduction of the content, the processor 82 generates the control signal CSb, and sends the signal CSb to the image switch section 3 for switching between the two input lines and the voice switch section 5 for switching between the two input lines (step S7). With this control signal CSb, the image switch section 3 is set to the state ready to receive the output of the video decoder 15, and the voice switch section 5 is set to the state ready to receive the output of the audio decoder 16. Thereafter, the content reproduction section 1 outputs a video and audio constituting the content in the same manner as that in step S1 (step S8).
During the repetition of processing steps S4 and S5, the video decoder 15 and the audio decoder 16 are free from operation. Therefore, to conserve consumption of power of the terminal device E1, the processor 82 may stop supplying power to these components. In this case, the processor 82 has to restart supplying power to these components in step S8.
After step S8, the processor 82 determines whether or not start instruction SLP has been received from the input device 10 (step S9). If not received, indicating that no read of the transport stream STT from the content storage section 9 is necessary, execution of step S8 is repeated. If start instruction SLP has been received, this means that time t2 (see FIG. 2) has been detected. Therefore, the processor 82 generates the control signal CSc for changing the input of the TS switch section 13 from the tuner 12 side to the control section 8 side, and sends the signal CSc to the TS switch section 13 (step S10). By this processing of step S10, the TS switch section 13 changes its input line as described above. The processor 82 then reads the transport stream STT stored in the content storage section 9, and transfers the transport stream STT to the TS switch section 13. The demultiplexer 14 receives the transport stream STT transferred via the TS switch section 13, demultiplexes the transport stream STT, and outputs the resultant encoded video signal CSLV and encoded audio signal CSLA to the video decoder 15 and the audio decoder 16, respectively. The video decoder 15 and the audio decoder 16 operate in the same manner as that in step S1, reproducing the video signal SLV and the audio signal SLA from the input encoded video signal CSLV and encoded audio signal CSLA, and outputting the respective signals to the display device 4 and the speaker 6. That is, the terminal device E1 reads and reproduces the object content (step S11). As a result, the portion of a video constituting the object content missed by the user during the voice communication is displayed on the display device 4, and audio synchronizing with the video is output from the speaker 6. In step S11, as in step S1, the control section 8 preferably controls the relevant components to block the transport stream STT output from the tuner 12 from being stored in the content storage section 9.
Thereafter, the processor 82 determines whether or not there is any part of the transport stream STT which has yet to be reproduced left in the content storage section 9 (step S12). If there is, execution of step S11 is repeated. If no part of the transport stream STT is left, meaning that the entire portion missed by the user during the voice communication has been reproduced, the processor 82 terminates the processing shown in FIG. 3.
By the processing described above, the terminal device E1 stores the transport stream STT in the content storage section 9 during voice communication. After the user finishes the voice communication and after the reception of the transport stream STT from the broadcast station 101 is finished, the terminal device E1 starts reproduction of the transport stream STT stored in the content storage section 9 in response to the start instruction SLP. In this way, it is possible to provide the terminal device E1 capable of outputting a portion of a content missed by the user due to voice communication at a time shifted from the actual broadcast time.
As described above, the terminal device E1 can stop storing the content in the content storage section 9 once the read from the content storage section 9 is started in step S11. Therefore, no unnecessary contents are recorded in the content storage section 9. This enables efficient use of the recording capacity of the content storage section 9.
In the embodiment described above, the status detection section 7 detects status changes of voice communication by way of the control signals CSM. The terminal device E1, typified by a cellular phone, is normally provided with an input device for entering the on-hook or off-hook state. Therefore, using a signal output from this input device, the status detection section 7 may detect the time point at which the telephony processing section enters the off-hook state as the first status change of the voice communication and the time point at which the telephony processing section 2 enters the on-hook state as the next status change of the voice communication.
In the embodiment described above, the telephony processing section 2 performs processing related to voice communication. Alternatively, the telephony processing section 2 may perform processing related to a videophone. In this case, the telephony processing section 2 is required to additionally perform reception/reproduction of image information on the side of the party on the other end of the voice communication, and display a video showing the party on the other end, in place of the image given by the image signal SLI described above, and also required to capture and encode image information on the side of the user.
In the embodiment described above, the content is assumed to be a TV program, but is not restricted thereto. For example, the content may be a radio program broadcast in a scheduled time frame according to a timetable made up by the radio broadcasting provider. Such a radio program is composed of audio represented by the audio signal SLA. Otherwise, the content may be music, composed of a video and audio, or composed of audio only, distributed as a stream from a server via a digital network typified by the Internet. Such music is provided as the audio signal SLA.
FIG. 4 is a block diagram showing the construction of a mobile communications terminal device (hereinafter, referred to as a terminal device for simplification) E2 that is a first variant of the terminal device E1 described above. In FIG. 4, the terminal device E2 has the same construction as the terminal device E1, except that a computer program (hereinafter, referred to as a program for simplification) CP2 is stored in the program memory 81 and that an input device 103 is used in place of the input device 10. Therefore, in FIG. 4, the same components as those of the terminal device E1 in FIG. 1 are denoted by the same reference numerals, and the description thereof is omitted here.
The program CP2 is the same in configuration as the program CP1. By executing the program CP2, however, the terminal device E2 performs some processing items different from those performed by the terminal device E1. This will be described below with reference to FIGS. 5 and 6.
The input device 103 outputs a signal SLF instructing end of reception/reproduction of the transport stream STT(hereinafter, referred to as end instruction) in response to an input from the user.
Next, an operation of the terminal device E2 described above is outlined with reference to FIG. 5. In FIG. 5, assuming that a call arrives when the terminal device E2 receives/reproduces the transport stream STT at time t0, the user is prevented from viewing the object content from time t0 until the voice communication is finished. The terminal device E2 therefore stores the transport stream STT received during the voice communication in the content storage section 9 while the user is prevented from viewing the content. Assuming that the voice communication is disconnected at time t1, the terminal device E2 reads the transport stream STT stored in the content storage section 9 from time t1, and reproduces the transport stream STT at n times speed (n is a number satisfying n>1). Specifically, the portion of the object content missed by the user due to the voice communication is read sequentially from the head thereof. During this time, therefore, the user is prevented from viewing the portion of the object content being broadcast according to the actual broadcast time (portion after time t1). Therefore, the terminal device E2 continues storing the transport stream STT, that is, the object content being broadcast according to the actual broadcast time after time t1 in the storage section 9. In this state, as n times speed time-shifted reproduction of the stored content is performed, the time lag between the content being reproduced and the content being broadcast is gradually reduced. Hence the transport stream STT to be stored in the content storage section 9 decreases. In other words, n times speed time-shifted reproduction is performed from time t1 to time t2. As will be understood from the above description, by means of the n times speed time-shifted reproduction, the object content is reproduced at n times speed along a time axis different from the actual digital broadcast time.
As a result of the n times speed time-shifted reproduction, the content storage section 9 becomes substantially vacant, and thus the read of the transport stream STT is no more possible at time t2. When this time t2 is detected, the terminal device E2 terminates the write of the content in the content storage section 9 and the read of the content from the content storage section 9, and instead receives/reproduces the transport stream STT being broadcast from the broadcast station 101 according to the actual broadcast time.
Referring to the flowchart of FIG. 6, the operation of the terminal device E2 outlined with reference to FIG. 5 will be described in detail. The flowchart of FIG. 6 is the same as that of FIG. 3, except that steps S21 to S27 are included in place of steps S7 to S12. Therefore, in FIG. 6, the same steps as those in FIG. 3 are denoted by the same step numbers, and the description thereof is omitted here.
If the processor 82 determines that the voice communication is disconnected in step S6, this means that time t1 (see FIG. 5) has been detected. Therefore, to perform the n times speed time-shifted reproduction, the processor 82 generates the control signal CSb and sends the signal to the image switch section 3 for switching between the two input lines and the voice switch section 5 for switching between the two input lines (step S21). With this control signal CSb, the image switch section 3 is set to the state ready to receive the output of the video decoder 15, and the voice switch section 5 is set to the state ready to receive the output of the audio decoder 16. In addition, for the n times speed time-shifted reproduction, the processor 82 generates the control signal CSc for changing the input of the TS switch section 13 from the tuner 12 side to the control section 8 side and also instructing the video decoder 15 and the audio decoder 16 to perform the n times speed time-shifted reproduction, and sends this signal to the TS switch section 13, the video decoder 15, and the audio decoder 16 (step S22). With this control signal CSc, the TS switch section 13 changes its input lines as described above, and the reproduction speed of the video decoder 15 and the audio decoder 16 is set at n times.
Thereafter, the processor 82 reads the transport stream STT stored in the content storage section 9 and transfers the transport stream STT to the TS switch section 13. During such read processing, the portion of the object content missed by the user due to the voice communication is sequentially read. In other words, the portion of the transport stream STT stored during the voice communication is sequentially read from the head thereof. The demultiplexer 14 demultiplexes the transport stream STT received via the TS switch section 13, and outputs the resultant encoded video signal CSLV and encoded audio signal CSLA to the video decoder 15 and the audio decoder 16, respectively. The video decoder 15 selects pictures required for the n times speed time-shifted reproduction from the received encoded video signal CSLV, decodes the selected pictures according to MPEG, and reproduces the video signal SLV. The reproduced video signal SLV is output to the display device 4 via the image switch section 3. The audio decoder 16 selects portions required for the n times speed time-shifted reproduction from the received encoded audio signal CSLA, decodes the selected portions according to MPEG, and reproduces the audio signal SLA. The reproduced audio signal SLA is output to the speaker 6 via the voice switch section 5. During such n times speed time-shifted reproduction, the transport stream STT output from the tuner 12 is written in the content storage section 9 under control of the processor 82. In this way, the terminal device E2 performs the n times speed time-shifted reproduction (step S23). As a result of the processing in step S23, the content missed by the user due to the voice communication is displayed from the head thereof on the display device 4 at n times speed, and audio synchronizing with the video is output from the speaker 6.
The processor 82 then determines whether or not there is any part of the transport stream STT which has yet to be reproduced left in the content storage section 9 (step S24). If there is, execution of step S23 is repeated. If no part of the transport stream STT is left, this means that the entire portion of the object content missed by the user due to the voice communication has been reproduced and also that time t2 (see FIG. 5) has been detected. Therefore, to perform reception/reproduction of the content, the processor 82 generates a control signal CSd for changing the input lines of the TS switch section 13 from the control section 8 side to the tuner 12 side and also instructing the video decoder 15 and the audio decoder 16 to perform normal-speed reproduction, and sends this signal to the TS switch section 13, the video decoder 15, and the audio decoder 16 (step S25). With such control signal CSd, the TS switch section 13 changes its input lines as described above, and the reproduction speed of the video decoder 15 and the audio decoder 16 is set at normal. Thereafter, the content reproduction section 1 reproduces the object content in the same manner as that in step S1 (step S26). The processor 82 then determines whether or not end instruction SLF has been received (step S27). If not received, it is determined that the user is still viewing the object content, and the processor 82 repeats the execution of step S26. If having received the end instruction SLF, the processor 82 determines that the user has finished viewing the content and terminates the processing shown in FIG. 6.
By the processing described above, the terminal device E2 writes the transport stream STT in the content storage section 9 from the start point of the voice communication (that is, time t0) till time t2 as shown in FIG. 5. At the end point of the voice communication (that is, time t1), the terminal device E2 starts n times speed time-shifted reproduction of the portion of the object content stored in the content storage section 9 missed by the user from the head thereof. This n times speed time-shifted reproduction is performed from time t1 until time t2. By this processing, the amount of the transport stream STT stored in the content storage section 9 can be reduced, and also the recording area for the transport stream STT can be soon freed up. This enables effective use of the recording area of the content storage section 9.
In the variant described above, the video decoder 15 and the audio decoder 16 select portions required for the n times speed time-shifted reproduction, and reproduce the selected portions. Alternatively, the processor 82 may read only portions required for the n times speed time-shifted reproduction from the transport stream STT stored in the content storage section 9, and transfer these portions to the TS switch section 13.
In the variant described above, the processor 82 determines when the n times speed time-shifted reproduction is returned to normal reproduction by examining whether or not any part of the transport stream STT is left in the content storage section 9. Alternatively, the n times speed time-shifted reproduction may be returned to the normal reproduction when the difference between the value of a presentation time stamp (PTS) included in the transport stream STT being written and the value of the PTS included in the transport stream STT being read becomes substantially zero.
As another case, if portions of the object content that the user will presumably consider unnecessary (typically, commercials) are skipped and only a TV program is reproduced, the content storage section 9 will become substantially vacant. The terminal device E2 may detect this time t2, and then may receive/reproduce the transport stream STT being broadcast from the broadcast station 101 according to the actual broadcast time. In this case, it is preferred not to write the portions that the user will presumably consider unnecessary in the content storage section 9. This can reduce the storage area occupied by the object content in the content storage section 9.
FIG. 7 is a block diagram showing the construction of a mobile communications terminal device (hereinafter, referred to as a terminal device for simplification) E3 that is a second variant of the terminal device E1 described above. In FIG. 7, the terminal device E3 has the same construction as the terminal device E1, except that a computer program (hereinafter, referred to as a program for simplification) CP3 is stored in the program memory 81 and that an image combining section 104 is provided in place of the image switch section 3. In FIG. 7, the same components as those of the terminal device E1 in FIG. 1 are denoted by the same reference numerals, and the description thereof is omitted here.
The program CP3 is the same in configuration as the program CP1. By executing the program CP3, however, the terminal device E3 performs some processing items different from those performed by the terminal device E1. This will be described below with reference to FIGS. 8 and 9.
During voice communication, the image combining section 104 receives the video signal SLV from the video decoder 15 and the image signal SLI generated by the control section 8. The image combining section 104 combines the input video signal SLV and the input image signal SLI for generating a combined image signal SLM, and outputs the combined signal to the display device 4. During reception/reproduction of the transport stream STT, the image combining section 104 outputs the video signal SLV from the video decoder 15 to the display device 4 as it is.
Next, an operation of the terminal device E3 described above is outlined with reference to FIG. 8. In FIG. 8, assume that a call arrives when the terminal device E3 receives/reproduces the transport stream STT at time t0 and that the voice communication is disconnected at time t1. In the embodiment and the variant described above, the user is prevented from viewing the object content during the time period from t0 to t1. In this variant, however, the terminal device E3 generates the combined image SLM as described above, and displays this image during the time period from t0 to t1. By displaying this image, the user can view the object content during the voice communication. In this way, the terminal device E3 can provide more enhanced operability.
Referring to the flowchart of FIG. 9, the operation of the terminal device E3 outlined with reference to FIG. 8 will be described in more detail. The flowchart of FIG. 9 is the same as that in FIG. 3, except that step S31 is included in place of step S4. Therefore, in FIG. 9, the same steps as those in FIG. 3 are denoted by the same step numbers, and the description thereof is omitted here.
If the status notification CSST indicating an incoming call has been received in step S2, the processor 82 starts execution of the program for voice communication processing included in the program CP3. The terminal device E3 then performs processing required for voice communication, and also generates and displays the combined image SLM (step S31). The processing required for voice communication is the same as that performed in the embodiment described above. In this variant, therefore, only the generation/display of the combined image SLM will be described in detail. The processor 82 generates the image signal SLI on the working area 83 if required, and sends the signal to the image combining section 104. The video signal SLV is also sent to the image combining section 104 from the video decoder 15 as described above. The image combining section 104 combines the input image signal SLI and the input video signal SLV for generating the combined image signal SLM in which a video of the broadcast content is superimposed on the image used during voice communication. The display device 4, receiving the combined image signal SLM and performing necessary display processing for the received signal, displays the image represented by the image signal SLI and a video of the object content. By the processing described above, the terminal device E3 can output the object content even during voice communication.
Although the terminal device E3 has been described as a variant of the terminal device E1, it may be a variant of the terminal device E2. That is, step S31 described above may be executed in place of step S4 in FIG. 6.
In the variant described above, the combined signal SLM was obtained by combining the object content and the image to be displayed during voice communication. Alternatively, if the transport stream STT includes multiplexed text data representing in characters what is expressed by the voice constituting the content, that is, caption data, the image combining section 104 may generate the combined image signal SLM additionally including the caption as shown in FIG. 10. If the telephony processing section 2 performs processing required for a videophone, the image combining section 104 may generate the combined image signal SLM additionally including an image of the party on the other end of voice communication as shown in FIG. 11. The image combining section 104 may also generate the combined image signal SLM further additionally including an image of the user as shown in FIG. 12.
FIG. 13 is a block diagram showing the construction of a mobile communications terminal device (hereinafter, referred to as a terminal device for simplification) E4 that is a third variant of the terminal device E1 described above. In FIG. 13, the terminal device E4 has the same construction as the terminal device E1, except that a computer program (hereinafter, referred to as a program for simplification) CP4 is stored in the program memory 81 and that a mute detection section 105 is additionally included. In FIG. 13, the same components as those of the terminal device E1 in FIG. 1 are denoted by the same reference numerals, and the description thereof is omitted here.
The program CP4 is the same in configuration as the program CP1. By executing the program CP4, however, the terminal device E4 performs some processing items different from those performed by the terminal device E1. This will be described below in detail with reference to FIGS. 14 and 15.
The mute detection section 105 receives the voice signal SLS1 output from the voice decoder 23. The mute detection section 105 typically detects a mute time period BNS during which the party on the other end of voice communication does not speak based on the amplitude value of the input voice signal SLS1, generates a timing signal SLT indicating a start or end point of the mute time period, and outputs the timing signal to the control section 8.
Next, an operation of the terminal device E4 described above is outlined with reference to FIG. 14. In FIG. 14, assume that times t0 and t1 are defined as described above. The user is prevented from hearing audio constituting the object content during the time period from t0 to t1 in the embodiment described above. In this variant, however, the terminal device E4 detects the mute time period BNS during which the party on the other end of voice communication does not speak based on the voice signal SLS1, and controls the input line of the voice switch section 5 so that the audio signal SLA from the audio decoder 16 is input into the speaker 6 during the detected mute time period BNS. By this processing, the user can hear the audio of the object content during the voice communication if it is in the mute time period BNS. In this way, the terminal device E4 can provide more enhanced operability.
The operation of the terminal device E4 outlined above is described in more detail with reference to the flowchart of FIG. 15. The flowchart of FIG. 15 is the same as that of FIG. 3, except that steps S41 to S44 are additionally included. Therefore, in FIG. 15, the same steps as those in FIG. 3 are denoted by the same step numbers, and the description thereof is omitted here.
After step S5, the processor 82 determines whether or not the timing signal SLT has been received from the mute detection section 105 (step S41). If not received, the processing proceeds to step S6 because no switching of the voice switch section 5 is required. If the timing signal SLT has been received, the processor 82 determines whether or not the signal indicates the end point of a mute time period BNS (step S42). If not, this means that the received timing signal SLT indicates the start point of the mute time period BNS. Therefore, the processor 82 generates a control signal CSd for changing the input line of the voice switch section 5 from the voice decoder 23 to the audio decoder 16, and outputs the generated control signal to the voice switch section 5 (step S43). On the other hand, if the timing signal SLT indicating the end point of the mute time period BNS has been received in step S42, the processor 82 generates a control signal CSe for changing the input line of the voice switch section 5 from the audio decoder 16 to the voice decoder 23, and outputs the generated control signal to the voice switch section 5 (step S44). Once the processing of step S43 or S44 described above is finished, the processor 82 executes step S4 again. By the processing described above, the terminal device E4 can output audio constituting the object content during voice communication if it is in the mute time period BNS.
Although the terminal device E4 was described as a variant of the terminal device E1, it may be a variant of the terminal device E2 or E3. That is, steps S41 to S44 described above may be incorporated in the flowchart of FIG. 6 or 9.
FIG. 16 is a block diagram showing the construction of a mobile communications terminal device (hereinafter, referred to as a terminal device for simplification) E5 as a fourth variant of the terminal device E1 described above. In FIG. 16, the terminal device E5 has the same construction as the terminal device E1, except that a computer program (hereinafter, referred to as a program for simplification) CP5 is stored in the program memory 81 and that a voice switch section 106 and first and second speakers 107 and 108 are provided in place of the voice switch section 5 and the speaker 6. In FIG. 16, therefore, the same components as those of the terminal device E1 in FIG. 1 are denoted by the same reference numerals, and the description thereof is omitted here.
The program CP5 is the same in configuration as the program CP1. By executing the program CP5, however, the terminal device E5 performs some processing items different from those performed by the terminal device E1. This will be described below in detail with reference to FIGS. 17 and 18.
The voice switch section 106 receives the audio signal SLA output from the audio decoder 16 and the voice signal SLS1, output from the voice decoder 23. During reception/reproduction of the transport stream STT, the voice switch section 106 outputs the input audio signal SLA to the first and second speakers 107 and 108. However, during voice communication, the voice switch section 106 outputs the input audio signal SLA to one of the first and second speakers 107 and 108 (the second speaker 108 in FIG. 16), and outputs the input voice signal SLS1 to the other speaker 107 or 108 (the first speaker 107 in FIG. 16). The voice switch section 106 switches its input/output lines in accordance with the control signal CSa or CSb output from the control section 8.
The first and second speakers 107 and 108 are L-side and R-side speakers, respectively, for stereo output.
Next, an operation of the terminal device E5 described above is outlined with reference to FIG. 17. The user is prevented from hearing audio constituting the object content during the time period from to t0 t1 in the embodiment described above. In this variant, however, as shown in FIG. 17, the terminal device E5 controls the voice switch section 106 so that the voice signal SLS1 received from the voice decoder 23 is output from the first speaker 107 and the audio signal SLA received from the audio decoder 16 is output from the second speaker 108. By this processing, the user can hear the audio of the object content even during voice communication. In this way, the terminal device E5 can provide more enhanced operability.
The operation of the terminal device E5 outlined above will be described in detail with reference to the flowchart of FIG. 18. The flowchart of FIG. 18 is the same as that of FIG. 3, except that steps S51 to S53 are included in place of steps S3, S4 and S7. Therefore, in FIG. 18, the same steps as those in FIG. 3 are denoted by the same step numbers, and the description thereof is omitted here.
If status notification CSST indicating an incoming call has been received in step S2, the processor 82 generates the control signal CSa, and sends the signal to the image switch section 3 for switching between the two input lines and the voice switch section 5 for switching between the two input lines (step S51). As a result, the image switch section 3 is set to the state ready to receive the output of the control section 8, and the voice switch section 5 is set to the state ready to receive both the outputs of the audio decoder 16 and the voice decoder 23.
The processor 82 then starts execution of the program for voice communication processing included in the program CPs. The terminal device E5 exchanges the multiplexed signal SLS with the base station 102 for voice communication, demultiplexes the encoded voice signal CSLS1 included in the multiplexed signal to reproduce the voice signal SLS1, and thus outputs the speech of the caller. The terminal device E5 also generates the encoded voice signal CSLS2 representing the speech of the user, multiplexes the encoded voice signal, and sends the resultant multiplexed signal SLS to the base station 102 (step S52). More specifically, the wireless communications part 22 switches its function between that of a demultiplexer and that of a multiplexer. The wireless communications part 22, as a demultiplexer, demultiplexes the multiplexed signal SLS input from the antenna 21 to obtain the encoded voice signal CSLS1, and outputs the encoded voice signal to the voice decoder 23. The voice decoder 23 decodes the input encoded voice signal CSLS1, and outputs the decoded voice signal SLS1, to one of the first and second speakers 107 and 108 via the voice switch section 106. At the same time, the audio decoder 16 outputs the reproduced audio signal SLA to the other speaker 107 or 108 via the voice switch section 106. By the processing described above, the speech of the caller and the audio of the content are output from the speakers 107 and 108.
The voice encoder 25 encodes the voice signal SLS2 from the voice input part 24, and outputs the encoded voice signal CSLS2 to the wireless communications part 22. The wireless communications part 22, as a multiplexer, multiplexes the input encoded voice signal CSLS2 and sends the resultant multiplexed signal SLS to the base station 102 via the antenna 21.
The processor 82 generates the image signal SLI on the working area 83 if required, and sends the signal to the display device 4 via the image switch section 3. By this processing, an image represented by the image signal SLI is displayed on the display device 4.
If it is determined that the voice communication has been disconnected in step S6, the processor 82 generates the control signal CSb and sends the signal to both the image switch section 3 and the voice switch section 106 for switching the input lines (step S53). As a result, the image switch section 3 is set to the state ready to receive the output of the video decoder 15, and the voice switch section 106 is set to the state ready to receive the output of the audio decoder 16. By the processing described above, the operation outlined with reference to FIG. 17 is obtained. That is, the terminal device E5 can output audio constituting the object content even during voice communication.
Although the terminal device E5 has been described as a variant of the terminal device E1, it may be a variant of the terminal device E2 or E3. That is, steps S51 to S53 described above may be incorporated in the flowchart of FIG. 6 or 9.
FIG. 19 is a block diagram showing the construction of a mobile communications terminal device (hereinafter, referred to as a terminal device for simplification) E6 as a fifth variant of the terminal device E1 described above. In FIG. 19, the terminal device E6 has the same construction as the terminal device E1, except that a computer program (hereinafter, referred to as a program for simplification) CP6 is stored in the program memory 81 and that an input device 109 and a preselection storage section 110 are additionally provided. In FIG. 19, therefore, the same components as those of the terminal device E1 in FIG. 1 are denoted by the same reference numerals, and the description thereof is omitted here.
The program CP6 is the same in configuration as the program CP1. By executing the program CP6, however, the terminal device E6 performs some processing items different from those performed by the terminal device E1. This will be described below with reference to FIGS. 20 and 21.
The input device 109 outputs a signal SLR indicating the channel and the broadcast start time of a content the user wants to view in the future (hereinafter, referred to as preselection information) to the control section 8 in response to the input from the user.
Next, an operation of the terminal device E6 described above is outlined with reference to FIG. 20. Preselection information SLR generated according to the user's input with the input device 109 is stored in the preselection storage section 110 of the terminal device E6. In FIG. 20, assume that the user is still engaged in voice communication using the terminal device E6 when broadcast of a content specified by the preselection information SLR (hereinafter, referred to as an object content) starts at time t0. The user is prevented from viewing the object content from time t0 until the voice communication is finished. Note that the content as used in this variant has the same definition as that described in the above embodiment. During the time period for which the user misses the content, the terminal device E6 stores the received transport stream STT in the content storage section 9. Assuming that the voice communication is finished and disconnected at time t1, the terminal device E6 reproduces the received transport stream STT at time t2 that is after time t1. In this way, the user can view the portion of the content broadcast during the voice communication.
The operation outlined above with reference to FIG. 20 is described in detail with reference to the flowchart of FIG. 21. In FIG. 21, the user inputs the channel and the broadcast start time of the object content with the input device 109 of the terminal device E6. In response to this input, the input device 109 generates preselection information SLR indicating the input information. The generated preselection information SLR is stored in the preselection storage section 110 (step S61).
When a control signal CSM indicating an incoming call is received by the voice communication processing unit 2, the processor 82 receives the status notification CSST from the status detection section 7 and, in response to this notification, executes the program for voice communication processing included in the program CP6. That is, the image switch section 3 is set to the state ready to receive the output of the control section 8, and the voice switch section 5 is set to the state ready to receive the output of the voice decoder 23. The terminal device E6 then exchanges the multiplexed signal SLS with the base station 102 for voice communication as in step S4 described above (step S62).
Thereafter, the processor 62 accesses the preselection storage section 110 and determines whether or not the time of broadcast of the object content designated by the preselection information SLR has come (step S63). If not, indicating that write of the transport stream STT is unnecessary, execution of step S62 is repeated. If the time of the start of the object program has come, the tuner 12 is set to receive the preselected channel under the control of the processor 82, and the processor 82 writes the transport stream STT output from the tuner 12 in the content storage section 9, as in step S5 described above (step S64). Subsequent to the write operation, the processor 82 determines whether or not the status notification CSST indicating disconnection of the voice communication has been received (step S65). If not received, indicating that reproduction of the transport stream STT stored in the content storage section 9 is unnecessary, execution of step S62 is repeated. If the status notification CSST indicating disconnection of the voice communication has been received, the processor 82 performs necessary processing in response to this notification and then terminates the write of the content in the content storage section 9. At the same time, the processor 82 generates the control signal CSa and sends the signal to the image switch section 3 for switching between the two input lines and the voice switch section 5 for switching between the two input lines (step S66).
As a result of the switching of the input lines in step S66, a video composing of the object content is displayed on the display device 4, and audio synchronizing with the video is output from the speaker 6, as in step S1 described above (step S67). Thereafter, the processor 82 determines whether or not the start instruction SLP has been received from the input device 10 (step S68). If not received, indicating that read of the transport stream STT from the content storage section 9 is unnecessary, execution of step S67 is repeated. If the start instruction SLP has been received, the processor 82 generates the control signal CSc for changing the input of the TS switch section 13 from the tuner 12 side to the control section 8 side, and sends the signal to the TS switch section 13 (step S69). By this step S69, the TS switch section 13 changes the input accordingly.
The processor 82 reads the transport stream STT stored in the content storage section 9 and transfers the transport stream to the TS switch section 13. The demultiplexer 14 demultiplexes the transport stream STT transferred via the TS switch section 13, and outputs the resultant encoded video signal CSLV and encoded audio signal CSLA to the video decoder 15 and the audio decoder 16, respectively. The video decoder 15 and the audio decoder 16 operate as in step S1 for reproducing the video signal SLV and the audio signal SLA (step S610). As a result, a video constituting the object content missed by the user during the voice communication is displayed on the display device 4, and audio synchronizing with the video is output from the speaker 6.
As in step S11, the processor 82 determines whether or not there is any part of the transport stream STT which has yet to be reproduced left in the content storage section 9 (step S611). If there is, execution of step S610 is repeated. If no part of the transport stream STT is left, this means that the user has viewed all the portion of the content missed due to the voice communication. Therefore, the processor 82 terminates the processing shown in FIG. 21.
By the processing described above, the operation outlined with reference to FIG. 20 is obtained. That is, during voice communication, the terminal device E6 writes the transport stream STT in the content storage section 9 once broadcast of the object program is started. After the voice communication is finished and after the reception of the transport stream STT from the broadcast station 101 is finished, reproduction of the transport stream STT stored in the content storage section 9 is started. In this way, it is possible to provide a communications terminal device capable of outputting the portion of the content missed by the user due to the voice communication at a time shifted from the actual broadcast time.
Although the terminal device E6 was described as a variant of the terminal device E1, it may be a variant of any of the terminals E2 to E5. Otherwise, the terminal device E6 may be combined with any of the terminals E1 to E5.
FIG. 22 is a block diagram showing the construction of a mobile communications terminal device (hereinafter, referred to as a terminal device for simplification) E7 as a sixth variant of the terminal device E1 described above. In FIG. 22, the terminal device E7 has the same construction as the terminal device E1, except that a computer program (hereinafter, referred to as a program for simplification) CP7 is stored in the program memory 81 and that the input device 10 is unnecessary. In FIG. 22, therefore, the same components as those of the terminal device E1 in FIG. 1 are denoted by the same reference numerals, and the description thereof is omitted here.
The program CP7 is the same in configuration as the program CP1. By executing the program CP7, the terminal device E7 performs some processing items different from those performed by the terminal device E1. This will be described below with reference to FIGS. 23 and 24.
Next, an operation of the terminal device E7 described above is outlined with reference to FIG. 23. In FIG. 23, the user is prevented from viewing the object content during the time period from t0 to t1 due to voice communication, as in the cases described above. The terminal device E7 writes the received transport stream STT in the content storage section 9 after time t1 until at least time t2 at which the broadcast of the object content is finished. After disconnection of the voice communication (time t1), the terminal device E7 reads the transport stream STT stored in the content storage section 9 and reproduces at the normal speed. This read is performed sequentially from the head of the portion of the object content missed by the user due to the voice communication and displayed for the view by the user. Therefore, the terminal device E7 displays the object content stored in the content storage section 9 for the user from time t1 until time t3 at which read of the object content from the content storage section 9 is finished. In other words, after the voice communication, the terminal device E7 performs time-shifted reproduction of the content along the time axis shifted from the actual broadcast time by time (t1-t0).
The operation outlined above with reference to FIG. 23 will be described in detail with reference to the flowchart of FIG. 24. The flowchart of FIG. 24 is the same as that of FIG. 3, except that steps S71 to S74 are included in place of steps S7 to S12. Therefore, in FIG. 24, the same steps as those in FIG. 3 are denoted by the same step numbers, and the description thereof is omitted here.
If it is determined that the voice communication has been disconnected in step S6, meaning that time t1 (see FIG. 23) has been detected, the processor 82 generates and sends the control signal CSb described above in relation to step S21 in FIG. 6 (step S71). With this control signal, the image switch section 3 and the voice switch section 5 are set to the respective states described above in relation to step S21. The processor 82 also changes the input line of the TS switch section 13 to the control section 8 side by sending the control signal CSc to the TS switch section 13 (step S72). As described above in relation to step S22 in FIG. 6, the control signal CSc is also sent to the video decoder 15 and the audio decoder 16 to set the reproduction speed thereof at the normal speed.
The processor 82 then reads the transport stream STT stored in the content storage section 9 and transfers the stream to the TS switch section 13. By this transfer, the portion of the object content missed by the user due to the voice communication is sequentially read from the head thereof. The demultiplexer 14 demultiplexes the transport stream STT transferred via the TS switch section 13, and outputs the resultant encoded video signal CSLV and encoded audio signal CSLA to the video decoder 15 and the audio decoder 16, respectively. The video decoder 15 reproduces the video signal SLV, which is output to the display device 4 via the image switch section 3. The audio decoder 16 reproduces the audio signal SLA, which is output to the speaker 6 via the voice switch section 5. At the same time, the transport stream STT output from the tuner 12 continues to be written in the content storage section 9 under the control of the processor 82. In this way, the terminal device E7 performs time-shifted reproduction (step S73). By the processing in step S73, an image of the content missed by the user due to the voice communication is displayed from the head thereof on the display device 4 at the normal speed, while audio synchronizing with the video is output from the speaker 6.
Thereafter, the processor 82 determines whether or not the time-shifted reproduction is finished (step S74). If not finished, execution of step S73 is repeated. If the time-shifted reproduction is finished, the processing shown in FIG. 24 is terminated.
By the processing described above, the operation outlined with reference to FIG. 23 is obtained. That is, the terminal device E7 writes the transport stream STT in the content storage section 9 from the start point of voice communication (that is, time t0). From the end point of the voice communication (that is, time t1), the terminal device E7 starts time-shifted reproduction of the portion of the object content missed by the user and stored in the content storage section 9, from the head of the portion. In this way, it is possible to provide a communications terminal device capable of outputting the portion of the content missed by the user due to the voice communication at a time shifted from the actual broadcast time.
FIG. 25 is a block diagram showing the construction of a mobile communications terminal device (hereinafter, referred to as a terminal device for simplification) E8 as a seventh variant of the terminal device E1 described above. In FIG. 25, the terminal device E8 has the same construction as the terminal device E1, except that a demultiplexer 120 is included in place of the demultiplexer 14 and that a computer program (hereinafter, referred to as a program for simplification) CP8 is stored in the program memory 81. In FIG. 25, therefore, the same components as those of the terminal device E1 in FIG. 1 are denoted by the same reference numerals, and the description thereof is omitted here.
The demultiplexer 120 demultiplexes the transport stream STT output from the TS switch section 13, and outputs the resultant encoded video signal CSLV and encoded audio signal CLSA to the video decoder 15 and the audio decoder 16, respectively, as does the demultiplexer 14. By this demultiplexing, the demultiplexer 120 also obtains a program map table (PMT) including at least the broadcast end time of the receiving content, and sends the PMT to the processor 82.
The program CP8 is the same in configuration as the program CP1. By executing the program CP8, however, the terminal device E8 performs some processing items different from those performed by the terminal device E1. This will be described below with reference to FIGS. 26 and 27.
Next, an operation of the terminal device E8 described above is outlined with reference to FIG. 26. In FIG. 26, the user has voice communication during the time period from t0 to t1, as in the above cases. If the object content finish at time t2 that is between time t0 and time t1, the processor 82 terminates the write of the object content in the content storage section 9.
The operation of the terminal device E8 outlined above with reference to FIG. 26 will be described in more detail with reference to the flowchart of FIG. 27. The flowchart of FIG. 27 is the same as that of FIG. 3, except that steps S81 to S83 are additionally included. Therefore, in FIG. 27, the same steps as those in FIG. 3 are denoted by the same step numbers, and the description thereof is omitted here.
After step S4, the processor 82 determines whether or not write terminating processing has been executed in step S83 (step S81). If not executed, the processor 82 proceeds to step S5. If the write terminating processing has been executed, the write of the received transport stream STT in the content storage section 9 is no more necessary. Therefore, the processor 82 skips step S5 and the following some steps and proceeds to step S6.
After step S5, the processor 82 determines whether or not the broadcast end time of the object content has come based on the PMT sent from the demultiplexer 120 (step S82). If determining that the broadcast end time has not come, the processor 82 proceeds to step S6. If it is determined that the broadcast end time has come, the processor 82 terminates the write of the object content in the content storage section 9 (step S83). In other words, the processor 82 discards the transport stream STT sent from the tuner 12, not transferring this to the content storage section 9. The processor 82 then performs step S6. By the processing described above, the write of the object content in the content storage section 9 is terminated upon end of the broadcast of the object content. This enables recording/reproduction suitable for the content storage section 9 whose recording capacity is small.
Although the terminal device E8 was described as a variant of the terminal device E1, it may be a variant of any of the terminals E2 to E7.
When a switch (not shown) is provided between the tuner 12 and the TS switch section 13, the processor 82 may control this switch to block the transport stream STT output from the tuner 12 from being input into the control section 8 in step S83.
In this variant, the processor 82 determines whether or not the end time of the object content has come based on the PMT. If an electric program guide (EPG) is obtainable, the processor 82 may determine whether or not the end time of the object content has come based on this obtained EPG.
In the embodiment and the variants described above, the processor 82 may detect the remaining recording capacity of the content storage section 9, determine the bit rate for the write of the object content based on the detected remaining capacity, and then store the object content in the content storage section 9 according to the determined bit rate.
In the embodiment and the variants described above, a program stream converted from the transport stream STT may be stored in the content storage section 9. Otherwise, an MPEG4-encoded transport stream STT may be stored in the content storage section 9.
While the invention has been described in detail, the foregoing description is in all aspects illustrative and not restrictive. It is understood that numerous other modifications and variations can be devised without departing from the scope of the invention.

## Claims

1. A communications terminal device comprising:
a tuner operable to receive a transport stream transmitted from a broadcast station, the transport stream containing a content;
a telephony processing section operable to receive and reproduce, by radio-wave, at least voice of a party on the other end of a voice communication;
a status detection section operable to detect a status change of the voice communication in said telephony processing section;
a content storage section operable to store the transport stream transmitted from the broadcast station;
a TS switch section operable to switch between the transport stream received from the broadcast station and the transport stream having been stored in said content storage section;
a reproduction section operable to reproduce either one of the transport stream received from the broadcast station and the transport stream having been stored in said content storage section;
a first input device operable to receive, from a user, preselection information indicating a channel and a broadcast start time of a content the user wants to view; and
a preselection storage section operable to store the preselection information,
wherein, when the broadcast start time of the content, which is indicated by the preselection information, arrives during the voice communication, the content storage section starts storing the transport stream broadcasted on the channel indicated by the preselection information.

2. The communications terminal device according to claim 1,  further comprising a second input device for receiving a start instruction, wherein
when the status detection section detects a disconnection of the voice communication, the content storage section ends storing the transport stream received from the broadcast station, and the reproduction section reproduces the transport stream received from the broadcast station, and
in accordance with the start instruction inputted after the disconnection of the voice communication is detected, the reproduction section starts reproducing the content stored in the content storage section.

3. The communication terminal device according to claim 1,
wherein, when said status detection section detects a disconnection of the voice communication, said reproduction section sequentially reproduces the transport stream having been stored in said content storage section, and
wherein, when the transport stream having been stored in said content storage section is reproduced until the transport stream having been stored in said content storage section aligns with the transport stream currently being output by said tuner, said content storage section ends storing the transport stream received from the broadcast station, and said TS switch section switches, in reproduction, from the transport stream having been stored in said content storage section to the transport stream received from the broadcast station.

4. The communications terminal device according to claim 3, further comprising:
an image generation section operable to generate image information relating to the voice communication; and
an image combining section operable to generate combined image information by combining the content received by said tuner and the image information generated by said image generation section when said status detection section detects a start of the voice communication,
wherein said image combining section is operable to generate the combined image information to which an image of the party on the other end of the voice communication is additionally included.

5. The communications terminal device according to claim 4,
wherein said telephony processing section is further operable to capture an image of the user side, and
wherein said image combining section is operable to generate the combined image information to which the captured image of the user is additionally included.

6. The communications terminal device according to claim 3,
wherein said reproduction section is operable to reproduce at least audio constituting the received content, and
wherein said communications terminal device further comprises:
a mute detection section operable to detect a mute time period of voice communication; and
a voice switch section operable to output the audio reproduced by said reproduction section during the mute time period detected by said mute detection section,
wherein said voice switch section is further operable to output a voice signal reproduced by said telephony processing section when said mute detection section detects no mute time period.