# Patent

## Title
System, method and apparatus for responding to device attachment

## Abstract

A television with at least one connection, either wired or wireless. Detection of an active device connected to the connection results in proper software and hardware configuration of the television to properly communicate with the device and provide, for example, proper user interface support and access to the device.

## Background
FIELD OF THE INVENTION
This invention relates to the field of display devices and more particularly to a system for detecting the attachment of a device to a display device and taking appropriate action.
BACKGROUND OF THE INVENTION
Television devices such as LCD or Plasma televisions are becoming more sophisticated each year. Already, most have a processor and memory and a remote control as an input device. Soon, many television devices will have Internet connections and mass storage devices (e.g., disk drives). The Internet connection and storage will be used for many purposes, including the download and storage of content (e.g., movies). The television devices have or will have input ports or other types of connections, either wired or wireless for the connection of devices such as phones, cameras, storage devices, printers, music players, etc.
There are many reasons for connecting such devices to a television device such as, providing an Internet connection (e.g., for content download), providing enhanced caller-id and speaker-phone capabilities to a cell phone, playing content that is stored on the device, printing part of an electronic program guide (EPG) that is stored in the television devices, uploading content such as fonts, patterns, etc., to the television devices, providing videophone capabilities to the television devices, etc.
When a device is connected to existing television devices, there is no reaction. For example, if a cell phone connected to a USB cable is connected into a USB port of the television device, the television device takes no action and it is difficult to perform any useful task with the cell phone and television device combination.
What is needed is a predictable system that provides detection and classification of a device when it is attached to a television device and, responsive to the attachment, activation of corresponding drivers/applets/applications.
SUMMARY
The present invention includes a television with at least one input mechanism, either wired or wireless. Detection of an active connection of a device to an input mechanism results in proper configuration of the television to properly communicate with the device and provide, for example, proper user interface support.
In one embodiment, system for detecting a connection of a device to a television is disclosed including a display panel integrated into the television with a processing element interfaced to the display panel and at least one connection to the television, each of the connections interfaced to the processing element. A device is connected to the television through one of the at least one connections and software running on the processing element recognizes activation of the device and, responsive to the activation of the device, configures the television to operate with the device.
In another embodiment, a method of detecting a connection of a device to a television is disclosed including detecting of the device, the device connected to the television through one of the at least one connections, recognizing activation of the device, and loading and running software in the television, responsive to the activation of the device. The software interfaces between the device and a processing element of the television.
In another embodiment, a television is disclosed including a system for detecting a connection of a device. The television includes a display panel and a processing element that is interfaced to the display panel. There is at least one connection to the television and each of the connections is interfaced to the processing element. A device is connected to the television through one of the at least one connections. Software running on the processing element is configured to recognize activation of the device and, responsive to the activation of the device, the software loads and runs a program that interfaces with the device.



BRIEF DESCRIPTION OF THE DRAWINGS
The invention can be best understood by those having ordinary skill in the art by reference to the following detailed description when considered in conjunction with the accompanying drawings in which:
FIG. 1 illustrates a schematic view of a television connected to the Internet of the present invention.
FIG. 2 illustrates a schematic view of a television connected to the Internet of the present invention with a connected device.
FIG. 3 illustrates a schematic view of the internal components of a typical device.
FIG. 4 illustrates a plan view of a television of the present invention with connections to a typical set of devices.
FIG. 5 illustrates a schematic view of a typical television of the present invention.
FIG. 6 illustrates a first flow chart of the present invention.
FIG. 7 illustrates a first second chart of the present invention.
FIG. 8 illustrates a plan view of a first typical on-screen display of the present invention.



DETAILED DESCRIPTION
Reference will now be made in detail to the presently preferred embodiments of the invention, examples of which are illustrated in the accompanying drawings. Throughout the following detailed description, the same reference numerals refer to the same elements in all figures.
Referring to FIG. 1, a schematic view of a television 5 of the present invention will be described. A greatly simplified schematic of a television 5 is shown in FIG. 1. Many components are not shown for brevity and clarity reasons. A typical television 5 has some sort of processing element 100 such as a digital signal processor, controller, single-chip processor (e.g., 80C51) or even a more capable processor such as an x386 scale processor. There is a memory 101 associated with the processor for execution of programs, etc. The memory is any combination of dynamic memory, static memory, flash memory, read only memory, erasable read only memory, etc.
All televisions 5 will have some sort of display panel 12, for example, a liquid crystal display (LCD) panel, a Plasma panel, an array of light emitting diodes (LEDS), a CRT and an organic LED (OLED), etc.
In this example, the television 5 is a connected television 5, connected to the Internet 8 (or other network) through a network interface 120. Such network interfaces 120 include, but are not limited to, wired connections through Ethernet (e.g., 802.3), Universal Serial Bus (USB), Firewire, serial, parallel, HDMI; or through wireless connections through WiFi (802.11), Bluetooth, etc. Also, in this example, is a storage device 124 such as a hard disk drive (HDD), a flash memory, etc. In general, the storage device 124 is some type of persistent memory for storage of programs, parameters and content, etc. Content is, for example, movies (video), music, still images, audio books, video books, digital books and the like.
The processing element 100 has access to the Internet 8 through the network interface 120. Through this, the processing element can retrieve data, content and/or programs (e.g., programs specific to the device) from a plurality of web sites connected through the Internet. The data is, for example, stock quotes, weather, time, etc. The content is, for example, movies, books, television programs, web pages, music, other audio, etc. The programs are, for example, driver programs, applications, applets, java scripts, HTML, etc. Some web sites 25 have storage containing the program 27 (e.g., applet) for downloading and running on the television's 5 processing element 100.
Also connected to the processing element 100 are one or more input ports 1/2 such as a USB port 1 or a firewire (IEEE 1394) port 2. In some televisions 5, an input is provided through a wireless connection 3 such as Bluetooth, 802.11, Infrared, IRDA, and the like.
Referring to FIG. 2, a second plan view of a television 5 with a device connected will be described. In this simplified example, the device 30 is connected by the USB interface 1, although the device 30 is anticipated to be connected through any known interface including, but not limited to, USB, Firewire (IEEE 1394), IRDA, Infra Red, 802.11, Ethernet, Cardbus, Bluetooth, etc.
When a device 30 is detected by the television's 5 processing element 100, several actions are possible, depending upon the device 30.
In one example, a standard device 30 such as a device that appears as external storage is connected to the USB connector 1. In response, the processing element 100 locates and runs an internal program or applet. Examples of external storage devices 30 include, but are not limited to, external hard drives, jump drives and devices that appear as external drives such as music players and cameras. In this example, the processing element 100 recognizes that the device 30 is configured to be external memory and processes the device 30 as known internally, either as part of the processing element's 100 existing program or as an add-on such as an applet or java script 29 stored within local storage 124. Responsive to the detection of the device 30 that appears as an external drive, the processing element 100 provides the user options, preferably though an on-screen-display, to manage files stored on the external drive. For example, the existing program or applet or java script provides a navigatable file selection menu (e.g., like Windows Explorer). Such a menu provides a list of files and permits selection of one or more files for copying to the television's 5 storage device 124, execution (in the case of a program, applet, java script, etc.), open (in the case of a movie, song, image, etc.). For example, if one of the files on the device's 30 storage is a music file such as an MP3 file, and it is selected through the on-screen-display, the processing element 100 decodes the music file and plays it through the television's 5 amplifier 110 and speakers 112 (see FIG. 5).
In another example, the device 30 is a cellular phone 40 (see FIG. 4) and connects to the processing element 100 through a Bluetooth wireless connection through the wireless network adapter 122 when the cellular phone 40 is located within range of the television 5 and enabled (e.g., the cellular phone 40 is powered and Bluetooth is enabled). In this example, the processing element 100 does not understand how to interface with the cellular phone 40, so the processing element accesses information from the cellular phone 40 such as manufacturer, model, revision and any other identifying information available as known in the industry. The processing element 100 then uses this identification information to search the local storage 124 to see if device-specific software programs (drivers and/or applets for this cellular phone 40) are available locally. If found, the processing element 100 runs the device-specific software programs (e.g. drivers/applets) to interface with the cellular phone 40. For example the device-specific software programs (e.g. drivers/applets) provide an Internet connection from the cellular phone 40 through the Bluetooth connection to the television 5 over which, for example, an electronic program guide is downloaded. In another example, the device-specific software programs (e.g. drivers/applets) integrates the cellular phone 40 with the television 5 such that when a call is received by the cellular phone 40, the caller id information is displayed on the television 5 and, the call is answered through the remote control 111 (see FIG. 5) and the audio from the cellular phone 40 is routed to the processing element 100, then to the amplifier 110 and speakers 112, thereby providing a speakerphone capability. Likewise, voice captured by a microphone 109 (see FIG. 5) is routed to the processing element 100 and then to the cellular phone 40.
In another example, the device 30 is a printer 56 (see FIG. 4) and connects to the processing element 100 through a USB 1 connection. In this example, the processing element 100 does not understand how to interface with the printer 56, so the processing element accesses information from the printer 56 such as manufacturer, model, revision and any other identifying information available as known in the industry. The processing element 100 then uses this identification information to search the local storage 124 to see if device-specific software programs (e.g. drivers/applets) for this printer 56 are available locally. If device-specific software programs (e.g. drivers/applets) for this printer are found, processing element 100 runs the device-specific software programs (e.g. drivers/applets) to interface with the printer 56. If not found and an Internet 8 connection is available through the network interface 120, the processing element 100 finds a web site associated with the printers 56 identification information and downloads device-specific software programs (e.g. printer drivers) for the printer 56. As an example, the printer drivers enable print functions from the television 5 so, for example, a page from an electronic program guide (EFP) or a digital image is printable through the USB 1 interface to the printer 56.
Referring to FIG. 3, a schematic view of a typical device 30 will be described. For the most part, devices 30 such as external memory devices, printers, cameras, etc., have several common or similar subsystems as shown in FIG. 3. Although many devices have other subsystems not shown (e.g., power suppliers, battery chargers, displays, keypads . . . ), these have been suppressed for brevity and clarity reasons.
In the simplified example of FIG. 3, the device 30 has a controller 32 (e.g., any processing device or devices, usually a digital signal processor or single chip computer) that connects to the television 5 through an interface cable 32. Internally to the device 30 is an I/O subsystem 36, for example, a display, keypad or buttons, an image sensor, a speaker or headphone jack, etc. Additionally, interfaced to the controller is typically some type of persistent storage 34 for storing video, audio, pictures, etc. Examples of the storage 34 are flash memory and hard disks.
Referring to FIG. 4, a plan view of a television 5 with a range of devices that connect to the television 5 will be described. Although there are other devices 30 that will connect, interface and interoperate with the television 5, some of the more common devices 30 are shown. A cellular phone 40 interfaces with the television 5 to, for example, provide an Internet 8 connection and/or speaker phone capabilities, etc.
A cellular phone 40 interfaces with the television 5 to, for example, provide an Internet 8 connection and/or speaker phone capabilities, etc.
A cellular phone 40 interfaces with the television 5 to, for example, provide an Internet 8 connection and/or speaker phone capabilities, etc.
A music player 42 interfaces with the television 5 to, for example, provide an enhanced user interface as well as playback through the television's 5 speakers 112, etc.
A camera 44 interfaces with the television 5 to, for example, provide a large-screen view of images stored on the camera and to upload one or more of the images to the television's storage 124, etc.
An external hard drive 46 interfaces with the television 5 to, for example, provide storage for content as with a personal video recorder (PVR), etc.
A computer 48 interfaces with the television 5 to, for example, provide enhanced television 5 configuration, creation of patterns such as screen savers, etc.
A keyboard 50 interfaces with the television 5 to, for example, provide enhanced input capabilities, etc.
A mouse 52 interfaces with the television 5 to, for example, provide improved control, for example, when accessing the Internet 8, etc.
A camera 54 interfaces with the television 5 to, for example, provide video phone capabilities, etc.
A printer 56 interfaces with the television 5 to, for example, provide hard copy of data and/or content from the television 5, etc.
A jump drive 58 interfaces with the television 5 to, for example, provide a way to copy content from a remote computer (not shown) to the television 5, etc.
Referring to FIG. 5, a schematic view of a typical television of the present invention will be described. This figure is intended as a representative schematic of a typical television 5 and in practice, some elements are not present in some monitors/televisions 5 and/or additional elements are present in some monitors/televisions 5. In this example, a display panel 12 is connected to a processing element 100. The display panel 12 is representative of any known display panel including, but not limited to, LCD display panels, Plasma display panels, OLED display panels, LED display panels and cathode ray tubes (CRTs).
The processing element 100 accepts video inputs and audio inputs selectively from a variety of sources including an internal television broadcast receiver 102, High-definition Media Inputs (HDMI), USB ports 1 and an analog-to-digital converter 104. The analog-to-digital converter 104 accepts analog inputs from legacy video sources such as S-Video and Composite video and converts the analog video signal into a digital video signal before passing it to the processing element. The processing element controls the display of the video on the display panel 12.
Audio emanates from either the broadcast receiver 102, the legacy source (e.g., S-Video) or a discrete analog audio input (Audio-IN). If the audio source is digital, the processing element 100 routes the audio to a digital-to-analog converter 106 and then to an input of a multiplexer 108. The multiplexer 108, under control of the processing element 100, selects one of the audio sources and routes the selected audio to the audio output and an internal audio amplifier 110. The internal audio amplifier 110 amplifies the audio and delivers it to internal speakers 112/114.
The processing element 100 accepts commands from a remote control 111 through remote receiver 113. Although IR is often used to communicate commands from the remote control 111 to the remote receiver 113, any known wireless technology is anticipated for connecting the remote control 111 to the processing element 100 including, but not limited to, radio frequencies (e.g., Bluetooth), sound (e.g., ultrasonic) and other spectrums of light. Furthermore, it is anticipated that the wireless technology be either one way from the remote 111 to the receiver 113 or two way.
In some embodiments, a microphone 109 is interfaced to the processing element 100 through, for example, an analog to digital converter 107. This is but an example of interfacing a microphone 109 to the processing element 100 and other methods are known and included here within.
Referring to FIG. 6, a first flow chart of the present invention will be described. This is an exemplary program flow executed within the processing element 100 upon detection of a device 30 being connected 60 to any input (e.g., USB input port 1). Information such as manufacturer, model number, type of device, home web site, serial number, etc., is retrieved 31 from the device 30 and the information is looked up 62 locally (e.g. in storage 124). If there is no match to the information locally, then it is determined if there is an active internet connection 66. If not, then the device cannot be recognized 68 and an error message and/or tone is emitted. If there is an active internet connection 66, then the Internet 8 is searched 70 for the identification information (e.g., at the device web site 25). If the identification information is not found 72 on the Internet 8, the support for the device 30 cannot be found and an error message and/or tone is emitted.
If identification information is found locally 62 or found 70 on the Internet 8, an applet, program, java script, driver, etc., is loaded from the local storage 124 or from a storage area 27 at the device web site 25. In some embodiments, the applet, program, java script, driver, etc., is stored on the local storage 124 for faster response the next time the same device 30 is connected to the television 5. The loaded applet, program, java script, driver, etc., is then run by the processing element 100 to provide the desired services from the device 30.
Referring to FIG. 7, a second chart of the present invention will be described. This is an exemplary program flow executed within the processing element 100 when a device 30 that is identified as an external storage device or external hard drive is connected 80. In this, since it is a storage device, the storage device is searched to find supported content such as movies, music, still pictures, spreadsheets, documents, etc. If no content if found 82, status is presented 84 to the user on the television 5. If content if found 82, some or all of the content is displayed in an on-screen display 86 (see FIG. 8) and the system waits for a command and when received 88, if it is an end command 90 (e.g., done with content on the device 30), the on-screen display is exited 92. Otherwise, the selected content is played (e.g., music played, movie played, image displayed, spreadsheet displayed, Powerpoint presentation started, etc.). Once the selected content is done being played, the flow continues with receiving a next command 88.
Referring to FIG. 8, a plan view of a typical on-screen display of the present invention will be described. Many user interfaces are known in the industry and the option selection user interface of FIG. 8 is but one example. In this example, the user is presented with the heading “Removable Drive Detected” 200 along with a list of possible selections 202/204/206. In the list of possible selections 202/204/206 are “Dirty Harry—movie” 202, “Beatles, Let it Be—sound album” 204 (similar to FIG. 3) and “Beatles, Something—song” 206. This is a greatly simplified version of such an on-screen display 200 and such an on-screen display typically contains navigation bars, hierarchies, folders, etc. In this simplified example, if the user selects one of the list of possible selections 202/204/206, the selected content is decoded by the processing element 100 (or other component of the television 5) and the content is delivered to the display panel 12 and/or the amplifier 110 and speakers 112.
Equivalent elements can be substituted for the ones set forth above such that they perform in substantially the same manner in substantially the same way for achieving substantially the same result.
It is believed that the system and method of the present invention and many of its attendant advantages will be understood by the foregoing description. It is also believed that it will be apparent that various changes may be made in the form, construction and arrangement of the components thereof without departing from the scope and spirit of the invention or without sacrificing all of its material advantages. The form herein before described being merely exemplary and explanatory embodiment thereof. It is the intention of the following claims to encompass and include such changes.

## Claims

1. A system for detecting a connection of a device to a television, the system comprising:
a display panel integrated into the television;
a processing element within the television, the processing element interfaced to the display panel;
at least one connection to the television, the connections interfaced to the processing element; and
said processing element communicating with a non-transitory medium that contains software, said software running on the processing element, the software configured to recognize activation of the device and, responsive to the activation of the device, the software configured to configure the television to operate with the device,
wherein said software is operative at a first time to recognize a mass storage device and to run an operation that automatically looks for supported content on the mass storage device that can be displayed on the display panel, and to display information about said supported content on the display panel, and said software is operative at a second time to recognize automatically a cellular telephone via a wireless connection, when the cellular phone is located within range of the television and enabled, the cellular telephone being a separate device from a remote control that is used to operate the television, and the software is operative to determine device specific information about the specific cellular telephone, and to provide device specific software programs to integrate the cellular phone with the television and thereafter to communicate with the cellular telephone after obtaining said device specific information to display at least a caller ID of an incoming call on the display panel and to allow using the television as a speaker phone, wherein the software is also operative to interface with the remote control which controls a television operation including at least changing television channels, said remote control being operable to answer calls on the cellular telephone after obtaining said device specific information from said cellular telephone.

2. The system of claim 1, wherein the software running on the processing element recognizes multiple different devices including all of a printer, a jump drive, a personal computer, an external hard drive, a keyboard, a mouse, a video camera, a cellular phone, a content player and a digital camera.

3. The system of claim 1, wherein the wireless connection is selected from the group consisting of Bluetooth, WiFi, 802.11, Ultra-wide band, infrared and IRDA.

4. The system of claim 1, wherein at least one of the at least one connection is a wired connection selected from the group consisting of universal serial bus, Firewire, serial, parallel, high definition media interface (HDMI), Ethernet and 802.3.

5. The system of claim 1, wherein the software is further configured to run an internal software program responsive to the activation of the device, the internal software program configured to interface with a class of devices.

6. The system of claim 5, wherein the class of devices includes removable storage devices selected from the group consisting of memory cards, jump drives, digital cameras, external hard drives and content players.

7. The system of claim 1, further comprising a storage device, the storage device interfaced to the processing element and the software further configured to load and run a device-specific software program responsive to the activation of the device.

8. The system of claim 1, further comprising a network interface, the network interface interfaced to the processing element and the software further configured to find a device-specific software program specific to the device by searching external systems connected to the network interface using said device specific information, to download the device-specific software program and to run the device-specific software program responsive to the activation of the device.

9. The system as in claim 8, wherein said device specific information from the cellular telephone includes at least a revision number of hardware of the device.

10. The system of claim 1, wherein said device specific information from the cellular telephone includes at least a revision number of hardware of the device.

11. A method of detecting a connection of a device to a television, the method comprising:
detecting a device, the device connected to the television through one of at least one connection;
recognizing activation of the device;
loading and running software in the television, responsive to the activation of the device; the software interfacing between the device and a processing element of the television
wherein said running software comprises operating at a first time to recognize a mass storage device as said device and to run an operation that automatically looks for supported content on the mass storage device that can be displayed on a display panel of said television, and to display information about said supported content on the display panel, and said software is operative at a second time to recognize automatically a cellular telephone as said device via a wireless connection when the cellular phone is located within range of the television and enabled, the cellular telephone being a separate device from a remote control that is used to operate the television, and the running software is operative to provide device specific software programs to integrate the cellular phone with the television and thereafter to determine device specific information about the specific cellular telephone, and to communicate with the cellular telephone after obtaining said device specific information to display at least a caller ID of an incoming call on the display panel and to allow using the television as a speaker phone, wherein the software is also operative to interface with the remote control which controls a television operation including at least changing television channels, said remote control being operable to answer calls on the cellular telephone after obtaining said device specific information from said cellular telephone.

12. The method of claim 11, wherein said software running on the processing element recognizes multiple different devices including all of a printer, a jump drive, a personal computer, an external hard drive, a keyboard, a mouse, a video camera, a cellular phone, a content player and a digital camera.

13. The method of claim 11, wherein the device is connected to the television by a wireless connection.

14. The method of claim 13, wherein the wireless connection is selected from the group consisting of Bluetooth, WiFi, 802.11, Ultra-wide band, infrared and IRDA.

15. The method of claim 11, wherein the device is connected to the television by a wired connection selected from the group consisting of universal serial bus, Firewire, serial, parallel, high definition media interface (HDMI), Ethernet and 802.3.

16. The method of claim 11, wherein the step of loading and running software includes:
loading an internal software program, the internal software program configured to interface with a class of devices.

17. The method of claim 16, wherein the class of devices includes removable storage devices selected from the group consisting of memory cards, jump drives, digital cameras, external hard drives and content players.

18. The method of claim 11, wherein the step of loading and running software includes:
loading a device-specific software program from a storage device, the storage device interfaced to the processing element, the device-specific software program configured to interface the device with the television.

19. The method of claim 11, wherein the step of loading and running software includes:
finding a device-specific software program from a network, the network interfaced to the processing element by a network interface, the device-specific software program configured to interface the device with the television; and
running the device-specific software program on the processing element.

20. A television having a system for detecting a connection of a device, the television comprising:
a display panel integrated into the television; a processing element within the television, the processing element interfaced to the display panel;
at least one connection to the television, the connections interfaced to the processing element;
a device, the device connected to the television through one of the at least one connections; and
software running on the processing element, the software configured to recognize activation of the device and, responsive to the activation of the device, the software configured to load and run a program, the program configured to interface with the device,
said processing element communicating with a non-transitory medium that contains software, wherein said software is operative at a first time to recognize a mass storage device and to run an operation that automatically looks for supported content on the mass storage device that can be displayed on the display panel, and that displays information about said supported content on the display panel, and said software is operative at a second time to recognize automatically a cellular telephone as said device via a wireless connection when the cellular phone is located within range of the television and enabled, the cellular telephone being a separate device from a remote control that is used to operate the television, and the running software is operative to provide device specific software programs to integrate the cellular phone with the television and thereafter to determine device specific information about the specific cellular telephone, and to communicate with the cellular telephone after obtaining said device specific information to display at least a caller ID of an incoming call on the display panel and to allow using the television as a speaker phone, wherein the software is also operative to interface with the remote control which controls a television operation including at least changing television channels, said remote control being operable to answer calls on the cellular telephone after obtaining said device specific information from said cellular telephone.

21. The television of claim 20, wherein software running on the processing element recognizes multiple different devices including all of a printer, a jump drive, a personal computer, an external hard drive, a keyboard, a mouse, a video camera, a cellular phone, a content player and a digital camera.

22. The television of claim 20, wherein at least one of the at least one connections is a wireless connection selected from the group consisting of Bluetooth, WiFi, 802.11, Ultra-wide band, infrared and IRDA.

23. The television of claim 20, wherein at least one of the at least one connection is a wired connection selected from the group consisting of universal serial bus, Firewire, serial, parallel, high definition media interface (HDMI), Ethernet and 802.3.

24. The television of claim 20, wherein the program is an internal program, the internal program configured to interface with a class of devices.

25. The television of claim 24, wherein the class of devices includes removable storage devices selected from the group consisting of memory cards, jump drives, digital cameras, external hard drives and content players.

26. The television of claim 20, further comprising a storage device, the storage device interfaced to the processing element and wherein the software program is a device-specific software program and the device-specific software program is loaded from the storage device.

27. The television of claim 20, further comprising a network interface, the network interface interfaced to the processing element and wherein the software is a device-specific software program and the processing element searches external systems connected to the network interface to find the device-specific software program, then downloads and runs the device-specific software program.

28. The system as in claim 20, wherein said device specific information from the cellular telephone includes at least a revision number of hardware of the device.