Abstract:
An example method and apparatus for audio-visual communication is provided. In some examples, a method as disclosed herein may include receiving an incoming call indication comprising a conversation request from a remote party, wherein the outgoing call request is displayed in a visual communication screen area on a display; establishing a communication link with the remote party in an instance in which an answering signal has been received, the communication link enabling a multi-directional audio and visual conversation; and causing a received video of the remote party to be displayed in the visual communication screen area, wherein the display is operable to display multimedia content in a multimedia screen area simultaneously with the received video of the remote party in the visual communication screen area.

Description:
CROSS-REFERENCE TO RELATED APPLICATIONS 
       [0001]    This non-provisional application is a continuation of U.S. application Ser. No. 14/021,757, filed Sep. 9, 2013, which is a continuation of U.S. application Ser. No. 13/193,560 filed Jul. 28, 2011, which is a divisional of Ser. No. 11/468,647 filed Aug. 30, 2006, now U.S. Pat. No. 8,013,938, which claims priority under 35 U.S.C. §119(a) on Patent Application No(s). 095116128 filed in Taiwan, R.O.C. on May 5, 2006, the entire contents of the foregoing are hereby incorporated by reference. 
         [0002]    This non-provisional application is a continuation of U.S. application Ser. No. 14/021,757, filed Sep. 9, 2013, which is also a continuation of U.S. application Ser. No. 13/193,567 filed Jul. 28, 2011, which is a divisional of Ser. No. 11/468,647 filed Aug. 30, 2006, now U.S. Pat. No. 8,013,938, which claims priority under 35 U.S.C. §119(a) on Patent Application No(s). 095116128 filed in Taiwan, R.O.C. on May 5, 2006, the entire contents of the foregoing are hereby incorporated by reference. 
     
    
     BACKGROUND OF THE INVENTION 
       [0003]    1. Field of Invention 
         [0004]    The present invention relates to a television, and more particularly, to a television integrated with a network. 
         [0005]    2. Related Art 
         [0006]    The number of users of audio-visual communication services over a network is growing rapidly with the maturity of the broadband network environment, due to the high quality of the audio-visual communication of the Voice over Internet Protocol (VoIP) and the network visual specifications (H.323), and the development of specifically designed communication software for these applications. 
         [0007]    However, currently, many video content and services are conducted over Internet, thus, the user has to use personal computers (PCs) or specialized network phones and specialized network video phones to enjoy the convenience of these services. Though many users spend more time on computers than on televisions, and they soon get used to take the computer as a tool for instant visual or voice communication, as for users who are not accustomed to or unfamiliar with computer operations, these services cannot be prevailing. 
         [0008]    The recent phone surveys conducted by two American market research companies: Points North Group and Horowitz Associates shows, 25% of the Internet users prefer to watch downloaded TV programs and movies on the computer, while 38% of the users prefer to enjoy this kind of videos on televisions. As for users with the age of 18-34, 68% of them are more interested in televisions, while 45% of them prefer to enjoy videos on computers. These data show that, though the computer has multiple functions and better interactivity, most users still prefer to use televisions, for example, to watch TV programs or films, to ease their busy activities on computers and to relax themselves. 
         [0009]    As can known from the above that, the television is a non-resistable medium for most consumers, and its popularity and convenience are far beyond the computer. Therefore, if the network visual or voice communication service can become available through simple operations on the televisions, the popularity of such service will be enhanced, thereby providing better opportunity to both networks and televisions. 
       SUMMARY OF THE INVENTION 
       [0010]    To solve the aforementioned problems, the present invention discloses a method of audio-visual communication using a television and the television using the same, which aims at enabling users to enjoy the network visual and voice communication service with a television, wherein the techniques of wired broadband or wireless broadband network and the digital television are integrated together. Thus, the television is not only capable of receiving broadcasted signals passively, but also capable of achieving bi-directional communication among users, and receiving the latest TV information while conducting communications synchronically. 
         [0011]    According to specific embodiments of the present invention, as for the network communication using the television, when the television is in standby or playing state, there are different processing procedures directed to incoming and outgoing calls. 
         [0012]    When the television is in the standby state, it receives the incoming call signals from a remote user, and conducts different operations according to the auto wakeup setting set by the user, i.e., the television is automatically turned on or not turned on. Then, the incoming-call information is displayed on the image of the television, and/or the incoming-call reminding sound is played with a remote controller or a built-in speaker of the television. At this time, the user can use the remote controller of the television or the television to select whether to answer the phone to enter the conversation state or not answer the phone to terminate the calling respectively. 
         [0013]    When the television is in the playing state, the television receives the incoming-call signal from the remote user, and displays the incoming-call information on the image, and/or plays the incoming-call reminding sound with the remote controller or the built-in speaker of the television. At this time, similarly, the user can further use the remote controller of the television or the television to select whether to answer the phone to enter the conversation state or not answer the phone to terminate the program respectively. 
         [0014]    When the user wants to make an outgoing call, he/she uses the remote controller of the television or the television to display the dial menu on the TV image, and then selects the remote user to be contacted with from the contact list of the dial menu, or inputs the number of the outgoing call via the remote controller to complete the dialing operation. Then, the user waits for a response from the remote user. 
         [0015]    The present invention further comprises a program of establishing the contact list. The user uses the remote controller of the television or the television to display the contact list on the TV image, and utilizes the functions of establishing and searching contacts on the contact list to connect to the network server terminal to search the contactor information, and to decide whether to add the contact information into the contact list or not depending upon the successful or failed searching response from the network server. 
         [0016]    According to the disclosure of the present invention, the user can utilize the Picture in Picture (PIP) technology to conduct the bi-directional visual conversation with the remote called party while watching television programs. Furthermore, multiple parties can make the visual communication at the same time without being influenced by the TV broadcasting, such as sports or educational programs. Through the method of the present invention, the users can hold discussions or research together, and the telecommunication cost can be saved significantly. On the other aspect, the user for example, can remote monitor his/her house with a personal digital assistant (PDA) or mobile phone via a built-in video camera or the remote controller of the television, thereby ensuring the security of the house. 
         [0017]    Further scope of applicability of the present invention will become apparent from the detailed description given hereinafter. However, it should be understood that the detailed description and specific examples, while indicating preferred embodiments of the invention, are given by way of illustration only, since various changes and modifications within the spirit and scope of the invention will become apparent to those skilled in the art from this detailed description. 
     
    
     
       BRIEF DESCRIPTION OF THE DRAWINGS 
         [0018]    The present invention will become more fully understood from the detailed description given herein below for illustration only, which thus is not limitative of the present invention, and wherein: 
           [0019]      FIG. 1  is a schematic view of a method of audio-visual communication using a television and a television using the same according to the present invention; 
           [0020]      FIG. 2  is a schematic view of a remote controller used together with the method of audio-visual communication using a television and the television using the same according to the present invention; 
           [0021]      FIG. 3  is a processing flow chart for the television in the standby state according to the present invention, when there is an incoming call; 
           [0022]      FIG. 4  is a processing flow chart of the television in the playing state according to the present invention, when there is an incoming call; 
           [0023]      FIG. 5  is a processing flow chart of an outgoing call according to the present invention; 
           [0024]      FIG. 6  is a flow chart for establishing the contact list according to the present invention; and 
           [0025]      FIG. 7  is a block diagram of functions for the television of the present invention. 
       
    
    
     DETAILED DESCRIPTION OF THE INVENTION 
       [0026]    Detailed features and advantages of the present invention are described below through embodiments, which is sufficient for those skilled in the art to understand the technical content of the present invention and to implement the present invention accordingly. 
         [0027]    Through the content of the specification, the claims, and the drawings, those skilled in the art can easily understand the objects and advantages of the present invention. 
         [0028]    Referring to  FIG. 1 , it is a schematic view of a method of audio-visual communication using a television and a television using the same according to the present invention. As shown in  FIG. 1 , the PIP  111  technology is used in the present invention, thus, the users  101 - 103  conduct network visual or voice conversation with remote users  101 - 103  over Internet  120  while watching TV  110 . Certainly, the Internet  120  can be a wired or wireless broadband network. According to a specific embodiment of the present invention, the users  101 - 103  can conduct a one-to-one visual communication or a multi-party visual communication. Referring to  FIG. 2 , it is a schematic view of a remote controller used together with a television according to the present invention. A video camera  112  used for visual communication is installed in the television  110  or on the remote controller  200  of the television. 
         [0029]    According to the circumstance that the television  110  is in a standby state or a playing state, there are different procedures for the incoming and outgoing calls in the present invention. Referring to  FIG. 3 , it is a processing flow chart  30  for the television  110  in the standby state when there is an incoming call. When there is an incoming call from a remote user (Step  301 ), the television  110  receives the incoming call signal from the remote user (Step  302 ). Then, the television  110  has different actions according to the auto wakeup setting set by the user (Step  303 ). If the user sets the television to have the auto wakeup function, the television  110  is automatically turned on and displays TV programs and information of the incoming call on the TV image, and plays the incoming-call reminding sound together with/without the remote controller  200  or the built-in speakers  213 ,  113  of the television (Step  304 ). When the incoming-call information or the incoming-call reminding sound has been received, the user selects whether to answer the call or not (Step  305 ). When the user selects to answer the call, he/she presses the OK/Talk button  201  on the remote controller  200  or the OK/Talk button on the operation panel of the television  110  to answer the call, and uses the built-in microphone  214  and speaker  213  of the remote controller  200  or the built-in microphone  114  and speaker  113  of the television  110  to answer and receive the call, and then, enters the conversation state (Step  306 ) until the call is over (Step  309 ). When the user selects not to answer the call, he/she presses the Cancel/End button  202  of the remote controller  200  or the Cancel/End button on the operation panel of the television  110  to select not to answer the call (Step  307 ), and thereby directly terminating the incoming call procedure (Step  309 ). 
         [0030]    On the other hand, when the user sets the television  110  to the non-auto wakeup state, the television  110  will not display any image, and the incoming-call reminding sound is played via the built-in speakers  213 ,  113  of the television  110  or the remote controller  200  (Step  308 ). At this time, the user selects whether to answer the call or not (Step  305 ). When the user selects to answer the call, he/she presses the OK/Talk button  201  on the remote controller  200  or the OK/Talk button on the operation panel of the television  110  to answer the call, and uses the built-in microphone  214  and speaker  213  of the remote controller  200  or the built-in microphone  114  and speaker  113  of the television  110  to answer and receive the call, and then, enters the conversation state (Step  306 ) until the call is over (Step  309 ). When the user selects not to answer the call, he/she presses the Cancel/End button  202  of the remote controller  200  or the Cancel/End button on the operation panel of the television  110  to select not to answer the call (Step  307 ) and thereby directly terminating the incoming call procedure (Step  309 ). 
         [0031]    According to a specific embodiment of the present invention, in Step  304 , when the remote user turns on the visual image, and when the television  110  is turned on, besides the broadcasted TV programs and the information of the incoming call, the visual image of the remote user is also displayed in the TV image. The user can set the TV programs to be displayed in the mother picture  115  (main picture) of the television  110 , and set the visual image of the user to be displayed in the son picture  111  of the television  110 . Alternatively, the user can also set the TV programs to be displayed in the son picture  111  of the television  110 , and set the visual image of the user to be displayed in the son picture  115  (main picture) of the television  110 . The incoming-call information can be displayed in one of the mother and son images, which can be the ID/account of the remote user or the phone number of the incoming call. When the user answers the incoming call, the incoming call information is changed into information about the conversation state, for example, the information of “In Conversation” is displayed. 
         [0032]    Referring to  FIG. 4 , it is a processing flow chart  40  of the television  110  in the playing state when there is an incoming call. The processing procedure comprises: when there is an incoming call from the remote user (Step  401 ), the television  110  receives signals of the remote user (Step  402 ) and at this time, displays the broadcasted TV programs and the incoming call information on the TV image, and/or plays the incoming-call reminding sound by the built-in speakers  113 ,  213  of the television or the remote controller  200  of the television (Step  403 ). After the user has received the incoming call information, the user selects whether to answer the call or not (Step  404 ). When the user selects to answer the call, he/she presses the OK/Talk button  201  on the remote controller  200  or the OK/Talk button on the operation panel of the television  110  to answer the call, and uses the built-in microphone  214  and speaker  213  of the remote controller  200  or the built-in microphone  114  and speaker  113  of the television  110  to answer and receive the call, and then, enters the conversation state (Step  405 ) until the call is over (Step  407 ). When the user selects not to answer the call, he/she presses the Cancel/End button  202  of the remote controller  200  or the Cancel/End button on the operation panel of the television  110  to select not to answer the call (Step  406 ) and thereby directly terminating the incoming call procedure (Step  407 ). 
         [0033]    According to a specific embodiment of the present invention, in Step  403 , when the  30  remote user turns on the visual image, besides the broadcasted TV programs and the incoming-call information, the visual image of the remote user is also displayed on the TV image. The user can set the TV programs to be displayed in the mother picture  115  (main picture) of the television  110 , and set the visual image of the user to be displayed in the son picture  111  of the television  110 . Alternatively, the user can also set the TV programs to be displayed in the son picture  111  of the television  110 , and set the visual image of the user to be displayed in the mother picture  115  (main picture) of the television  110 . The incoming-call information is displayed in one of the mother and son images, which can be the ID/account of the remote user or the phone number of the incoming call. When the user answers the incoming call, the incoming-call information is changed into information about the conversation state, for example, the information of “In Conversation” is displayed. 
         [0034]    Referring to  FIG. 5 , it is a processing flow chart  50  of an outgoing call. When the user turns on the television  110  (Step  501 ), he/she uses the dial button  205  of the remote controller  200  or the dial button on the operation panel of the television  110  to display the dial menu on the TV image (Step  502 ). The dial menu comprises the contact list. The user uses the select button on the operation panel of the television  110  or the select button  206  of the remote controller  200  to select the remote user to be contacted with from the contact list, or uses the number buttons  207  of the remote controller  200  to input and dial the phone number of the outgoing call (Step  503 ). When the user presses the OK/Talk button  201  of the remote controller  200  or the OK/Talk button on the operation panel of the television  110  to select to confirm the dialing operation, the dialing operation is completed, and at this time, the user waits for the response from the remote user (Step  504 ). If the remote user answers the call, both two parties enter the conversation state (Step  505 ) until the call is over (Step  507 ). If the remote user doesn&#39;t answer the phone or hangs up the phone (Step  506 ), the user uses the re-dial button  203  of the remote controller  200  to re-dial or directly terminate the outgoing-call procedure (Step  507 ). According to a specific embodiment of the present invention, in Step  504 , when the user completes the dialing operation, the information about the current dialing state is displayed on the images of the television  110 , for example, the information of “Dialing” is displayed. 
         [0035]    As described above, the contact list in the processing flow chart of an outgoing call  50   30  can be established by way of searching. For example, a remote user is added into the contact list by means of searching an account or an IP address. Referring to  FIG. 6 , it is a flow chart  60  for establishing the contact list. Firstly, the user turns on the television  110  (Step  601 ). The user uses the dial button  205  of the remote controller  200  or the dial button on the operation panel of the television  110  to display the contact list on the TV image  5  (Step  602 ). The contact list has the functions of establishing and searching information. The user uses the select button on the operation panel of the television  110  or the select button  206  of the remote controller  200  to input the information of the account or IP address of the remote user to be added or searched. At this time, if the user wants to cancel the establishing or searching function, he/she selects to leave the interface by pressing the skip button  204  of the remote controller  200  or the skip button on the operation panel of the television  110  (Step  603 , Step  607 ). After the user has completed the input of the information to be established, the information is stored in the contact list; or after the user has completed the input of the information to be searched, the operations of searching and comparing the information can be conducted by connecting to the server terminal of the network via the Internet (Step  604 ). If the network server gives a respond of success, the user adds the account or IP address of the remote user into the contact list, and then, the user can perform the information searching again, or select to leave (Step  605 ). If the network server gives a response of failure, the user can input the information to search again, or select to leave (Step  606 , Step  607 ). 
         [0036]    Referring to  FIG. 7 , it is a block diagram  70  of functions for the television of the present invention. As shown in  FIG. 7 , the television  110  comprises a receiving unit  701 , a transmitting unit  702 , a processing unit  703 , a display unit  704 , a sound amplifying unit  705 , a sound pickup unit  706 , a video shooting unit  707 , a memory unit  708 , and a control unit  709 . The aforementioned components are used to achieve the procedures of incoming and outgoing calls of the present invention. The receiving unit  701  is used to receive the incoming call signal or TV signal from remote users  101 - 103 , and is connected to the processing unit  703 , so as to pass the incoming call signal to the processing unit  703  for being processed. The processing unit  703  decides whether to turn on the image of the television or not according to the auto wakeup settings set by the user, and compares the account or phone number of the remote user who sent out the incoming call signal. with the information in the memory unit  708 . If the image of the television  110  is turned on, the processing unit  703  transmits the compared account or phone number of the remote user to the display unit  704 , so as to display the information of the incoming call. Meanwhile, the processing unit  703  plays the incoming-call reminding sound via the sound amplifying unit  705 , and/or transmits a control command to the remote controller  200  via the transmitting unit  702 , such that the sound amplifying unit (e.g., speaker  113 ) of the remote controller  200  also plays the incoming-call reminding sound, thereby reminding the user of an incoming call, wherein the sound amplifying unit  705  may be, for example, the speaker  213 . If the image of the television  110  is not turned on, the processing unit  703  only plays the incoming-call reminding sound via the sound amplifying unit  705  and/or the speaker  113  of the remote controller  200 . 
         [0037]    The user can use the control unit  709 , such as the OK/Talk button on the operation panel of the television  110 , or use the OK/Talk button  201  on the remote controller  200  to select to answer the call, or uses the control unit  709 , such as the Cancel/End button on the operation panel of the television  110 , or use the Cancel/End button  202  on the remote controller  200  to select not to answer the call. After the call has been answered, the user uses the sound pickup unit  706 , such as the built-in microphone  114  of the television  110 , or use the built-in microphone  214  of the remote controller  200  to make a conversation, and uses the video shooting unit  707 , such as the built-in video camera  112  of the television  110  or the built-in video camera  112  of the remote controller  200  to capture images to achieve the visual communication. Then, the sound pickup unit  706  and the video shooting unit  707  respectively transmit the received sound signals and image signals to the processing unit  703 , or the built-in microphone  214  and the video camera  112  of the remote controller  200  respectively transmit the received sound signals and image signals to the processing unit  703 . Thus, the processing unit  703  performs the digital signal processing of the sound signals and image signals, including encoding/compressing/modulating signals, and then transmits the processed signals to the remote user via the transmitting unit  702 . 
         [0038]    When an outgoing call of the user is processed, and the user presses the control unit  709 , such as the OK/Talk button on the operation panel of the television  110 , or the dial  30  button  205  of the remote controller  200 , the control unit  709  transmits the control command to the processing unit  703 , or the remote controller  200  transmits the control command to the receiving unit  701 , and then, the receiving unit  701  transmits the control command to the processing unit  703 . The processing unit  703  receives the control command, and commands the display unit  704  to display the dial menu. The user inputs the dialing number/account number via the control unit  709 , such as the select buttons on the operation panel of the television  110 , and transmits the number to the processing unit  703 , or inputs the dialing number/account number via the select buttons  206  or number buttons  207  of the remote controller  200 , and transmits the number to the receiving unit  701 , and then, the receiving unit  701  transmits the dialing number/account number to the processing unit  703 . When the user has completed the input, he/she inputs the dial command via the control unit  709 , such as the OK/Talk button on the operation panel of the television  110 , and transmits the dial command to the processing unit  703 , or inputs the dial command with the OK/Talk button  206  of the remote controller  200 , and transmits the dial command to the receiving unit  701 , and then, the receiving unit  701  transmits the dial command to the processing unit  703 . After the processing unit  703  has received the dial command, the dialing action is conducted, and the information of the above remote user is sent to the Internet  120  via the transmitting unit  702 . As described above, the Internet  120  can be a wired or wireless broadband network. 
         [0039]    When the user wants to establish the contact list, he/she presses the control unit  709 , such as the OK/Talk button on the operation panel of the television  110 , or the dial button  205  of the remote controller  200 . At this time, the control unit  709  transmits the control command to the processing unit  703 , or the remote controller  200  transmits the control command to the receiving unit  701 , and then, the receiving unit  701  transmits the control command to the processing unit  703 . After the processing unit  703  has received the control command, it commands the display unit  704  to display the dial menu. The dial menu contains the contact list. The user inputs a first searching command via the control unit  709 , such as the select buttons on the operation panel of the television  110 , and transmits the first searching command to the processing unit  703 , or inputs the first searching command via the select buttons  206  on the remote controller  200 , and transmits the first searching command to the receiving unit  701 , and then, the receiving unit  701  transmits the first searching command to the processing unit  703 . After the processing unit  703  has received the first searching command, it commands the display unit  704  to display the accounts to be input or address list. The user inputs the accounts or addresses via the control unit  709 , such as select buttons on the control panel of the television  110 , and transmits the accounts or addresses to the processing unit  703 , or inputs the accounts or addresses via select buttons  206  or number buttons  207  of the remote controller  200 , and transmits the accounts or addresses to the receiving unit  701 , and then, the receiving unit  701  transmits the accounts or addresses to the processing unit  703 . After the user has completed the input operation, he/she inputs a second searching command via the control unit  709 , such as the OK/Talk button on the operation panel of the television  110 , and transmits the second searching command to the processing unit  703 , or inputs the second searching command via the OK/Talk button  206  of the remote controller  200 , and transmits the second searching command to the receiving unit  701 , and then, the receiving unit  701  transmits the second searching command to the processing unit  703 . After the processing unit  703  has received the second searching command, it conducts the searching operation, and transmits the aforementioned accounts or addresses to Internet  120  via the transmitting unit  702 . 
         [0040]    To sum up, as for the audio-visual communication method disclosed in the present invention, operation flows of both the “incoming call procedure” and the “outgoing call procedure” are similar to that of the normal local phones or mobile phones. As for the publics who are not accustomed to or unfamiliar with computer operations, the present invention provides optimal convenience in operation. Furthermore, through the method and apparatus of the present invention, the user can non-interruptedly receive information broadcasted via televisions together with the audio-visual communication on the basis of a simple architecture. Therefore, the user can acquire more sufficient experiences on communications. 
         [0041]    Till now, descriptions about different procedures for incoming and outgoing calls and the procedures for establishing and searching the contact list according to the present invention have been disclosed, and furthermore, the devices for achieving the procedures have also been disclosed. 
         [0042]    The invention being thus described, it will be obvious that the same may be varied in many ways. Such variations are not to be regarded as a departure from the spirit and scope of the invention, and all such modifications as would be obvious to one skilled in the art are intended to be included within the scope of the following claims.