# Patent

## Title
Methods, systems and apparatus for displaying the multimedia information from wireless communication networks

## Abstract

Video signals for a mobile terminal are converted to accommodate reproduction by an alternative display terminal. The video signal is processed to provide a converted video signal appropriate for an alternative display terminal that is separate from the mobile terminal. This converted video signal is then provided for the alternative display terminal to accommodate the corresponding video display on a screen provided by the alternative (e.g., external) display terminal.

## Background
CROSS REFERENCE TO RELATED APPLICATIONS
This application is a continuation of U.S. application Ser. No. 12/929,408, filed on Jan. 21, 2011, which is a continuation of U.S. application Ser. No. 11/165,341, filed on Jun. 24, 2005, now U.S. Pat. No. 7,899,492, issued Mar. 1, 2011 and entitled “Mobile Terminal Signal Conversion for External Display,” which claims the benefit of provisional application Ser. No. 60/588,358, filed on Jul. 16, 2004 and entitled “A Method and System for Displaying the Multimedia Information from Wireless Communications or Portable IT Devices.” The entire contents of these applications are hereby incorporated by reference.


BACKGROUND OF THE INVENTION
1. Field of the Invention
This invention relates generally to mobile terminals and related technology and more particularly to mobile terminal signal conversion for external display.
2. Description of the Related Art
Handheld mobile terminals (e.g., cellular phones, personal digital assistants (PDA)) continue to evolve both in terms of execution platform and functionality. It is believed that the much of the functionality provided by a personal computer (e.g., desktop or laptop) will ultimately become virtually available in handheld mobile terminals, which will allow users to work with and access multimedia information any time and anywhere.
For example, one particularly appealing advantage of the next generation wireless communication system and beyond (i.e., 3G, 4G, etc.) is the capacity to support high rate multimedia data services as well as conventional voice services. In a conventional cellular system a mobile terminal communicates with a base station wirelessly. Multimedia information including but not limited to television, 3D images, network games, and video phone calls is transmitted from various service providers and received for display on the screen of a mobile terminal. The net result of such a system is rich multimedia information being destined for display on the small screens typical of cellular phones (or the like).
In these and similar systems, the mobile terminal functions as a multimedia terminal to display multimedia information (including high-resolution graphics and high-quality real-time audio/video) sent from high data rate wireless communications network. The limited size (e.g., 2×3′′) and capability of the mobile terminal screen may render enjoyment of the high rate data flow applications inconvenient, and in some instances useless. One consequence of this inadequacy is likely shrinkage of the potential market size for handheld mobile terminals. Indeed, some have suggested that development of high data rate systems such as 3G systems may be pointless given the limitations imposed by the small screen.
Some mobile units appear to provide a remote control function to an external display system. However, these do not appear to solve the small screen problem outlined above. That is, they do not accommodate display on a larger, external display of video and other multimedia information originally destined for the mobile terminal display screen.
For example, one such interface accommodates usage of the mobile terminal as a remote control for a television, by feeding programming guide information to the mobile terminal. This is useful for allowing the programming guide to be viewed locally while the larger screen displays a current program, but does not address to the above-described small screen problem.
Although mobile terminals have been developed to include enhanced signal processing and related capabilities, user enjoyment is diminished by the limitations of the display provided with such mobile terminals. What is needed is a solution to the problem of diminished user enjoyment of mobile terminals because of display limitations.
SUMMARY OF THE INVENTION
In accordance with the present invention, the multimedia signal destined for the mobile terminal is converted and provided to an external display system, so that the corresponding video and/or audio may be reproduced using the external system.
It is believed that this feature will be useful in various environments, including but not limited to transportation environments such as planes, trains and automobiles; hotels; waiting areas; and any location where high data rate services can be more fully supported by external display terminals.
According to one aspect, processing signals for reproduction by an external display terminal includes receiving a video signal that accommodates a video display on a first screen provided by the mobile terminal. The video signal is then processed to provide a converted video signal appropriate for an external display terminal that is separate from the mobile terminal. This converted video signal is then provided for the external display terminal to accommodate the corresponding video display on a screen provided by the external display terminal.
The present invention can be embodied in various forms, including business processes, computer implemented methods, computer program products, computer systems and networks, user interfaces, application programming interfaces, and the like.



BRIEF DESCRIPTION OF THE DRAWINGS
These and other more detailed and specific features of the present invention are more fully disclosed in the following specification, reference being had to the accompanying drawings, in which:
FIG. 1 is a schematic diagram illustrating an example of a system in which mobile terminal signal conversion may reside in accordance with the present invention.
FIG. 2 is a block diagram illustrating an example of a mobile terminal signal conversion module in accordance with the present invention.
FIG. 3 is a block diagram illustrating another example of a mobile terminal signal conversion module in accordance with the present invention.
FIG. 4 is a flow diagram illustrating an embodiment of a process including mobile terminal signal conversion in accordance with the present invention.
FIG. 5 is a schematic diagram illustrating another example of a system in which mobile terminal signal conversion may reside in accordance with the present invention.
FIG. 6 is a schematic diagram illustrating still another example of a system in which mobile terminal signal conversion may reside in accordance with the present invention.
FIG. 7 is a schematic diagram illustrating examples of mobile terminal signal conversion applications in accordance with the present invention.



DETAILED DESCRIPTION OF THE INVENTION
In the following description, for purposes of explanation, numerous details are set forth, such as flowcharts and system configurations, in order to provide an understanding of one or more embodiments of the present invention. However, it is and will be apparent to one skilled in the art that these specific details are not required in order to practice the present invention.
FIG. 1 is a schematic diagram illustrating an example of a system 100 in which mobile terminal signal conversion may reside in accordance with the present invention.
Mobile terminal signal conversion accommodates displaying the high rate data flow multimedia information available in a wireless communication environment in an external device. This accommodates true realization and enjoyment of the benefits of the multimedia content.
In one example, the multimedia information is provided to a wireless mobile terminal using so-called next generation cellular technology (i.e., 3G and 4G), which can be employed in transmitting multimedia information (e.g., rich graphics, real-time audio/video). Because of the relatively small screen size and low quality ear phones, for many applications the mobile terminal cannot adequately reproduce the high quality multimedia information that can be communicated using next generation technology with adequate clarity and satisfaction. Mobile terminal signal conversion in accordance with this embodiment of the present invention makes usage of a separate multimedia display terminal including but not limited to a monitor, television set, projector, or LCD display. These displays typically have video and audio reproduction capabilities that are superior to those found on mobile terminals. They also use a power supply that is separate from the mobile terminal.
Still referring to the system 100 illustrated in FIG. 1, multimedia information may be provided by any number of service providers 102a-b and delivered through a network 104 to a base station 106 to ultimately accommodate transmission of the multimedia information, among other things, to a cellular phone 108. This system 100 is provided by way of example, and it should be understood that any conventional or to-be-developed technology for delivering voice and/or data to mobile terminals may be provided. These wireless communication networks include but are not limited to a cellular communications network or a wireless local area network.
Also illustrated is a typical external display system 114. This may also be variously provided and may be digital or analog. Examples of digital systems include HDTV, LCD and plasma. Examples of analog systems include television sets that implement standards such as NTSC, PAL, SECAM, and analog computer monitors (SVGA, VGA). The external display system 114 does not have the size constraints of the display screen on the cellular phone 108 and is preferably powered independently.
In the illustrated embodiment, a mobile terminal signal conversion module (MTSCM) 112 resides within a separate housing 110, outside the cellular phone 108.
The functionality of the MTSCM 112 is now further described with concurrent reference to FIG. 1 and the flow diagram of FIG. 4.
The MTSCM 112 processes signals to accommodate reproduction by an external device. Specifically, a multimedia signal is transmitted to the cellular phone 108 through the wireless communications network as previously described (step 402). The multimedia signal may include a video signal intended for reproduction by the cellular phone 108, using the cellular phone display screen. For ease of description, processing of a video signal is described, although it should be understood that any multimedia signal or component thereof may be converted in accordance with the present invention.
The cellular phone 108 is connected to the MTSCM 110. This may be accommodated by a cable connection that interfaces the cellular phone 108 to the MTSCM 112 housing 110. Through this connection, the MTSCM 112 receives the video signal from the cellular phone 108 (step 404). The video signal as received may be configured to accommodate a video display on the screen provided by the cellular phone 108. The cable connection is an example of a wired connection interfacing the cellular phone 108 to the MTSCM 112. An alternative wired connection is a seat that directly interfaces the two without a cable. A wireless connection may also be provided, although it may currently be less practical to provide than the wired connection because of the potential for high throughput rate requirements. The wireless connection may also implement any conventional known technology including but not limited to a Bluetooth connection.
The MTSCM 112 processes the video signal to provide a converted video signal that has a display format and/or signal power level appropriate for an external display terminal 114 that is separate from the cellular phone 108 (step 406). The display format and/or signal power level of the external display terminal 114 may be different from that of the cellular phone 108 but there may also be embodiments where the format is the same. Even if the formats are the same, conversion of the signals to accommodate display on the external display terminal 114 would still be implemented to adjust the power level for driving the external display, and possibly to minimize throughput requirements. This signal conversion is described further with reference to FIGS. 2 and 3, below.
Still referring to FIGS. 1 and 4, following signal conversion, the MTSCM 112 provides the converted video signal to the external display terminal 114 to accommodate the corresponding video display on a screen provided by the external display terminal 114 (step 408). This may be accommodated through a connection between the MTSCM 112 housing 110 and the external display terminal 114 as shown.
As used herein, mobile terminal refers to typically handheld mobile devices such as cellular phones and personal digital assistants. Although these devices include an execution platform as well as input and display capabilities, such devices are distinguished from personal computers, such as desktop or laptop computers, which are not designed for convenient handheld usage.
FIG. 2 is a block diagram illustrating an example of an MTSCM 200 in accordance with the present invention. The MTSCM 200 may be provided as software, firmware, hardware, or any combination thereof.
Where the MTSCM 200 is provided as software, it operates in the context of an execution platform. That is, the MTSCM 200 includes instructions that are stored in memory for execution by a processor. Any conventional or to-be-developed execution platform may be used. The processor, memory, and related elements such as a power supply are well known and need not be described herein to convey an understanding of the invention. Additionally, FIG. 2 illustrates one modular breakdown for the components of the MTSCM 200. It should be understood that the described functionality may alternatively be provided by an MTSCM having fewer, greater, or differently named modules from those illustrated in the figure.
Additionally, although modules as shown to reside in a common location, it is noted that the functionality may reside in separate components of a system that includes a mobile terminal, an external monitor, and (optionally) an intermediate device housing the MTSCM and interfacing the mobile terminal and external monitor. In other words, the overall functionality of the MTSCM may be separated such that portions of the overall functionality are respectively provided by the mobile terminal, separate intermediate housing, and/or the external display device.
The MTSCM 200 may also be provided in the form of a chipset, configured for inclusion in a mobile terminal, dedicated separate signal conversion device, or external display terminal, and to provide the described mobile terminal signal conversion functionality.
The MTSCM 200 includes a mobile terminal interface module 202, a signal conversion module 204, and an external device interface module 206.
The mobile terminal interface module 202 accommodates receiving the multimedia signal from the mobile terminal. A conventional physical interface provides a connection between the MTSCM 200 and the mobile terminal through which the signals flow to the MTSCM 200. The mobile terminal interface module 202 recognizes the multimedia signal and stores the signal for processing by the remaining modules. Buffering and the like may be implemented to accommodate storage and signal processing, as described further below.
The signal conversion module 204 is in communication with the mobile terminal interface module 202 and thus accesses the received multimedia signal. The signal conversion module 204 recognizes the multimedia signal format, and processes the multimedia signal to provide a converted signal. The converted signal may have a format and a signal power level that differs from the one used by the mobile terminal, as appropriate for one or more types of external devices to which the MTSCM 200 is connected. Various examples of the type of devices to which the MTSCM 200 may be connected are illustrated and described in connection with FIG. 3, below.
The external device interface 206 is in communication with the signal conversion module 204 and thus accesses the converted signal. The external device interface 206 also allows connection to the external (e.g., display) device. The external device interface 206 may provide both the feeding of the converted signal to the external device, and driving the external device. Alternatively, the external device interface 206 may merely feed the converted signal to the external device, with the external device including internal elements for driving its signal reproduction (e.g., display) facilities.
FIG. 3 is a block diagram illustrating another example of the MTSCM 300. The MTSCM 300 includes additional detail regarding the signal conversion aspect, and illustrates examples of differing types of external devices to which the MTSCM 300 may provide converted signals. The illustration and corresponding description are provided by way of example. Although numerous connections are illustrated, it should be understood that the present invention may be practiced in the context of providing as few as one, and as many as all of the listed connections. It should also be understood that there may be additional examples that are not listed herein, but which are encompassed by the teachings described herein.
The MTSCM 300 includes an interface/buffer module 302 that is analogous to the previously described mobile terminal interface module. The buffer and interfacing are configured to accommodate signal processing by the remaining elements in support of the requirements and expectations of users of the multimedia signal output (e.g., adequate buffering and processing rate to provide real time audio/video). The mobile terminal video compression format may of course vary, but currently the most likely format is MPEG-1 or MPEG-2. Buffering and throughput rate may also be provided as desired by the designer. Currently, it is believed that 200 Mb is an adequate buffer size, although buffers of 500 Mb or more may of course be provided. Additionally, a throughput rate of approximately 10 Gb/s will be adequate for many current systems, but may be increased as demands and technology evolve.
The Video Compress Decoder 304a receives the multimedia signal. The multimedia signal is typically provided in a compressed format to accommodate increased signal transfer rates. An example of a compression scheme is that provided by one of the MPEG standards (e.g., MPEG-1, MPEG-2, MPEG-4). The Video Compress Decoder 304a is configured to include the appropriate compression/decompression (CODEC) module to accommodate decompression of the received multimedia signal. For example, where the compression scheme is MPEG, the Video Compress Decoder 304a includes an MPEG CODEC to accommodate processing of such multimedia signals.
As an alternative to provision of the Video Compress Decoder 304a in the MTSCM 300, the functionality may be provided within the cellular phone or other mobile terminal. However, this may be less practical because of the high bandwidth that would be required between the cellular phone and the MTSCM 300 to deliver the decompressed signal, and the corresponding likelihood of a larger buffer requirement for the MTSCM 300.
The Video Compress Decoder 304a outputs a decompressed digital multimedia signal that is passed to the Digital/Analog Video Encoder (DAVE) 304b and/or the Digital/Digital Video Encoder (DDVE) 304c. The DAVE 304b is configured to prepare signals for analog external display terminals 320, and the DDVE 304c is configured to prepare signals for digital external display terminals 322. The DAVE 304b and DDVE 304c respectively receive the decompressed multimedia signal and convert the signals to the format(s) and signal power level(s) required for the terminals to which they interface.
Examples of formats used by analog display terminals 320 include S-video, RGBHV, RGBS, and EIA770.3 as illustrated. Similarly, the DDVE 304c provides output using standards such as DVI, DVI-D, HDMI, and IEEE1394. The signals respectively provided by the DAVE 304b and DDVE 304c are provided to the terminals through conventional interfaces 306a-b. The DAVE 304b functionality may be embodied as a video card that is configured accordingly. Examples of video cards that may be configured to provide the described functionality include but are not limited to the Diamond Stealth S60, ASUS V9400-X, or RADEON 7000.
Ultimately, the signals are used to provide a display on the external display, as required according to the particular type of display. For example, the video data stream may be a digital RGB signal which represents the intensity of the red, green and blue light respectively at different position. This signal is converted to analog by a D/A converter. This converted analog signal is quantified to the voltage and format required by the standard, such as the input of cathode-ray-tube (CRT) monitor. This standard video signal will drive a set of electron guns, which produce a controlled stream of electrons to display of red, green and blue light respectively on a CRT screen. This is but one example and the present invention is not limited to a particular technology (e.g., CRT) for the external display.
As described, in one embodiment the MTSCM may be independently housed separately from both the mobile terminal and external display terminal, with respective connections to the other devices to provide a system configuration that includes the three pieces of hardware (mobile terminal, conversion box, external display terminal). This configuration provides the flexibility of allowing any standard mobile terminal and/or display to be potentially interface with the MTSCM without imposing constraints on the mobile terminal or external display terminal manufacturers. A possible drawback to this configuration is that additional hardware is introduced into the system.
In lieu of the three component system, the MTSCM may be located in either the mobile terminal or the external display. FIG. 5 is a schematic diagram illustrates an example of a system 500 in which the MTSCM mobile terminal signal conversion may reside within the mobile terminal 508. The components and functionality of the service providers 502a,b network 504 and base station 506 for delivering multimedia signals to the mobile terminal 508 is the same as for the analogous elements of FIG. 1 and need not be re-described. Similarly, the external display terminal 514 may be any of the various types named above.
The MTSCM 512 provides the same functionality described above. However, in contrast to residence in a separate housing, the MTSCM 512 is a component of the mobile terminal 508. A potential advantage of this system 500 is that, again, any standard equipment can serve as an external display terminal 514, without a constraint on the display manufacturer. Additionally, only a simple wired or wireless interface is required to connect the external display with the mobile terminal 508. This means, for example, that the user will not be required to carry a bulky conversion module in addition to their cellular phone.
A potential drawback to this system 500 is that the execution platform of the mobile terminal 508 may be designed to accommodate only traditional functionality, so for some systems it may be challenging to add the MTSCM functionality to the existing platform. Additionally, the MTSCM will consume power that may unduly exhaust the limited power supply offered by the mobile terminal 508 battery. It is useful for this embodiment to provide power to the mobile terminal 508 through the cable connection to the external display terminal 514, but again this may require modification to the mobile terminal 508 as the existing charger interface may be insufficient.
FIG. 6 is a schematic diagram illustrating another example of a system 600, in which the MTSCM 612 resides within the external display terminal 614. As with FIG. 5, the components and functionality of the service providers 602a,b network 604 and base station 606 for delivering multimedia signals to the mobile terminal 608 is the same as for the analogous elements of FIG. 1 and need not be re-described.
Here, the mobile terminal 608 need only be connected directly to the external display terminal 614. However, in lieu of having the MTSCM 612 functionality reside within the mobile terminal 608, it is part of the external display terminal 614. The power supply and execution platform issues associated with placing the MTSCM 614 in the mobile terminal are resolved with this system 600, and any mobile terminal 608 can potentially be connected to any MTSCM-ready external display without requiring modification, other than provision of an output interface. A potential drawback of this configuration is that it adds a component to the standard external display terminal, and corresponding costs.
FIG. 7 is a schematic diagram illustrating examples of mobile terminal signal conversion applications 700 in accordance with the present invention. These applications 700 are provided by way of example, to give the reader an understanding of the potential contexts in which embodiments of the present invention may operate. The present invention is not limited to the disclosed applications, nor are all potential applications required for any given embodiment.
The basic architecture for provision of the wireless communications signal and corresponding multimedia signal is as described above for the service providers 702a-b, network 704, base station 706 and mobile terminal 708. The MTSCM 710 may be separate or reside in the mobile terminal 708 or display terminal 712. Examples of applications 714 where a larger screen and potentially superior audio may be enjoyed include video conference, HDTV, games, GPS, and video on demand. Additionally, embodiments of the present invention will accommodate enjoyment of full multimedia capability in locations 716 including vehicles, airports, hotels and remote resorts. Thus, for example, the present invention accommodates usage inside a vehicle, a plane or any type of transportation, enabling the passenger to browse the Internet, watch TV, play games, participate in a video conference or call, and work on all sorts of software with full functionality.
Thus embodiments of the present invention produce and provide mobile terminal signal conversion. Although the present invention has been described in considerable detail with reference to certain embodiments thereof, the invention may be variously embodied without departing from the spirit or scope of the invention. Therefore, the following claims should not be limited to the description of the embodiments contained herein in any way.

## Claims

1. A method for processing signals to accommodate reproduction by an alternative display terminal, the method comprising:
receiving, by a conversion device, a video signal appropriate for displaying a video content on a mobile terminal, the video signal being sent from a wireless network communication;
processing, by the conversion device, the video signal to produce a converted video signal for use by the alternative display terminal, wherein processing by the conversion device includes converting a signal format appropriate for the mobile terminal to a display format for the alternative display terminal that is different from the signal format, the display format being a high definition digital format, such that the converted video signal produced by the conversion device comprises the high definition digital format for output to the alternative display terminal; and
providing the converted video signal from the conversion device to the alternative display terminal to accommodate displaying the video content by the alternative display terminal.

2. The method of claim 1, wherein the mobile terminal is a cellular phone.

3. The method of claim 1, wherein the mobile terminal is a personal digital assistant.

4. The method of claim 1, wherein receiving the video signal, processing the video signal to produce the converted video signal, and providing the converted video signal to the alternative display terminal are performed using power from a source that differs from the internal power supply of the mobile terminal.

5. The method of claim 1, wherein the conversion device resides in a housing of the alternative display terminal.

6. The method of claim 1, wherein the video signal received by the conversion device is part of a multimedia signal that is originally received by the mobile terminal in a cellular network communication before it is received by the conversion device from the mobile terminal.

7. The method of claim 1, wherein the wireless network communication includes a cellular network communication.

8. The method of claim 1, wherein providing the high definition format of the converted video signal from the conversion module to the alternative display terminal is through a high definition multimedia interface (HDMI).

9. The method of claim 1, wherein the conversion device resides in the mobile terminal.

10. The method of claim 1, wherein the conversion device includes the mobile terminal and an intermediary between the mobile terminal and the alternative display terminal.

11. A non-transitory computer readable medium storing program code for operating a conversion device, the program code being executable to perform operations comprising:
receiving, by the conversion device, a video signal appropriate for displaying a video content on a mobile terminal, the video signal being sent from a wireless network communication;
processing, by the conversion device, the video signal to produce a converted video signal for use by the alternative display terminal, wherein processing by the conversion device includes converting a signal format appropriate for the mobile terminal to a display format for the alternative display terminal that is different from the signal format, the display format being a high definition digital format, such that the converted video signal produced by the conversion device comprises the high definition digital format for output to the alternative display terminal; and
providing the converted video signal from the conversion device to the alternative display terminal to accommodate displaying the video content by the alternative display terminal.

12. The computer readable medium of claim 11, wherein the mobile terminal is a cellular phone.

13. The computer readable medium of claim 11, wherein the mobile terminal is a personal digital assistant.

14. The computer readable medium of claim 11, wherein receiving the video signal, processing the video signal to produce the converted video signal, and providing the converted video signal to the alternative display terminal are performed using power from a source that differs from the internal power supply of the mobile terminal.

15. The computer readable medium of claim 11, wherein the conversion device resides in a housing of the alternative display terminal.

16. The computer readable medium of claim 11, wherein the video signal received by the conversion device is part of a multimedia signal that is originally received by the mobile terminal in a cellular network communication before it is received by the conversion device from the mobile terminal.

17. The computer readable medium of claim 11, wherein the wireless network communication includes a cellular network communication.

18. The computer readable medium of claim 11, wherein the high definition format of the converted video signal is a high definition multimedia interface (HDMI) format, and providing the converted video signal from the conversion device to the alternative display terminal is through an HDMI interface.

19. The computer readable medium of claim 11, wherein the conversion device resides in the mobile terminal.

20. The computer readable medium of claim 11, wherein the conversion device includes the mobile terminal and an intermediary between the mobile terminal and the alternative display terminal.

21. An apparatus for converting video signals, the apparatus comprising:
an input interface for receiving a video signal appropriate for displaying a video content on a mobile terminal, the video signal being sent from a wireless network communication;
a processing unit for processing the video signal to produce a converted video signal for use by the alternative display terminal, wherein the processing includes converting a signal format appropriate for the mobile terminal to a display format for the alternative display terminal that is different from the signal format, the display format being a high definition digital format, such that the converted video signal produced by the processing unit comprises the high definition digital format for output to the alternative display terminal; and
an output interface for providing the converted video signal to the alternative display terminal to accommodate displaying the video content by the alternative display terminal.

22. The apparatus of claim 21, wherein the mobile terminal is a cellular phone.

23. The apparatus of claim 21, wherein the mobile terminal is a personal digital assistant.

24. The apparatus of claim 21, further comprising means for providing power to provide power for receiving the video signal, processing the video to produce the converted video signal, and providing the converted video signal to the alternative display terminal.

25. The apparatus of claim 21, wherein the video signal received by the processing unit is part of a multimedia signal that is originally received by the mobile terminal in a cellular network communication before it is received by the processing unit from the mobile terminal.

26. The apparatus of claim 21, wherein the wireless network communication includes a cellular network communication.

27. The apparatus of claim 21, wherein providing the converted video signal from the processing unit to the alternative display terminal is through high definition multimedia interface (HDMI).

28. The apparatus of claim 21, wherein the processing unit resides in the mobile terminal.

29. The apparatus of claim 21, wherein the apparatus comprises multiple hardware components for carrying out said processing of the video signal.