Source: http://www.google.com/patents/US20050097478?dq=patent:7076806
Timestamp: 2016-12-08 22:30:00
Document Index: 240578329

Matched Legal Cases: ['art 800', 'art 800', 'art 800', 'art 900', 'art 900', 'art 900']

Patent US20050097478 - User interface for multi-device control - Google PatentsSearch Images Maps Play YouTube News Gmail Drive More »Sign inPatentsA control server, or similar central processor, manages the distribution of data (including audio and video), voice, and control signals among a plurality of system components connected via a wired and/or wireless communications network. The system components include audio/visual components (such as,...http://www.google.com/patents/US20050097478?utm_source=gb-gplus-sharePatent US20050097478 - User interface for multi-device controlAdvanced Patent SearchTry the new Google Patents, with machine-classified Google Scholar results, and Japanese and South Korean patents.Publication numberUS20050097478 A1Publication typeApplicationApplication numberUS 10/783,511Publication dateMay 5, 2005Filing dateFeb 23, 2004Priority dateNov 3, 2003Also published asCA2544399A1, EP1687989A2, EP1687989A4, US8042049, US20120266095, WO2005043935A2, WO2005043935A3Publication number10783511, 783511, US 2005/0097478 A1, US 2005/097478 A1, US 20050097478 A1, US 20050097478A1, US 2005097478 A1, US 2005097478A1, US-A1-20050097478, US-A1-2005097478, US2005/0097478A1, US2005/097478A1, US20050097478 A1, US20050097478A1, US2005097478 A1, US2005097478A1InventorsDavid Killian, Glenn Harter, Justin Flores, Paul KrzyzanowskiOriginal AssigneeOpenpeak Inc.Export CitationBiBTeX, EndNote, RefManPatent Citations (92), Referenced by (132), Classifications (17), Legal Events (3) External Links: USPTO, USPTO Assignment, EspacenetUser interface for multi-device control
DETAILED DESCRIPTION OF THE INVENTION [0027] The present invention is directed towards the centralized command and control of a plurality of devices and/or applications within a controlled environment, such as a residence, business, school, etc. A residential controlled environment includes the confines of a home, apartment, mobile home, houseboat, or other types of residences. However in embodiments, a residential environment includes the surrounding area of the residence, as well as any shelters, constructs, improvements, or the like, within a designated perimeter. [0028] In other embodiments, the present invention is implemented in non-residential environments. A non-residential environment includes, but is not limited to, an office complex, suite of small offices, production studio, warehouse, entertainment arena, school or university, health care facility, hotel, vacation resort, aircraft, ship, automobile, or the like. In embodiments, the controlled environment for the non-residential embodiments include not only the actual confines of the aforementioned structures but also their surroundings within a designated perimeter. [0029] Examples of a controlled environment are described in the application entitled “Method, System, and Computer Program Product for Managing Controlled Residential or Non-Residential Environments” (U.S. patent application Ser. No. 10/382,897), and the application entitled “Method, System, and Computer Program Produce for Managing Controlled Residential or Non-Residential Environments,” (U.S. patent application Ser. No. 10/180,500), both of which are incorporated herein by reference as though set forth in their entireties. As described in these applications, various methods and systems can be provided to manage the distribution of information (including video, audio, voice, text, graphics, control messages, etc.) to the other devices and/or applications within the controlled environment. Such devices and/or applications include, but are not limited to, communications equipment (such as, telephones, intercoms, etc.), entertainment systems (such as, televisions, CD/DVD players, gaming applications, stereos, etc.), monitoring systems (such as, security cameras, baby monitors, etc.), safety/security systems (such as, fire alarms, sprinkler systems, locks on doors or windows, etc.), personal computers (such as, desktops, notebooks, notepads, personal digital assistants, etc.), cooking appliances (such as, ovens, coffee makers, electrical food/beverage warmers, etc.), comfort systems (such as, heating and air conditioning (HVAC), humidifiers, dehumidifiers, air purifiers, light switches, light dimmers, etc.), power outlets, power supplies, or the like. [0030] An example of such controlled environments are shown in FIG. 1, which illustrates a residential controlled system 100 according to an embodiment of the present invention. System 100 includes a communications network 180 that interconnects with a plurality of system components. The system components include a positioning unit 102, two televisions 104 (shown as television 104(a) and 104(b)), two computer clients 106 (shown as computer client 106(a) and computer client 106(b)), a portable controller 108, a lighting device 110, a thermostat 112 for a HVAC system, a tuner 114, a media player 116, a cable box 118, and a DSS box 120. Other devices and/or applications can also be included as system components. [0031] Positioning unit 102 designates spatial locations within the residence that serves as the hosting environment for system 100. Positioning unit 102 is coupled to the other system components (e.g., portable controller 108) via a wired and/or wireless interface. Positioning unit 102 is operable to designate a floor or room within the residence. Positioning unit 102 is also operable to designate a specific location or region within a floor or room. Moreover, positioning unit 102 can be situated outside of the residence to thereby, designate external areas of the residence. [0032] Computer client 106 includes a wired and/or wireless personal computer, personal digital assistant (PDA), enhanced telephone, personal television, or other data processing device linked to communications network 180. As a personal computer, computer client 106 can be a desktop, notebook, notepad, or the like. [0033] Portable controller 108 is a wired and/or wireless data processing device that enables a user to interact with, send control messages to, and/or manage the distribution of information (including audio, video, voice, and other data) among the other system components. Portable controller 108 can be a portable version of the devices listed as computer client 106. For example, portable controller 108 can be a personal notebook or notepad computer, PDA, enhanced telephone, or other device linked to communications network 180 and including a display with the ability to interact with the other system components. Hence, portable controller 108 enables a user to remotely control the operations of various components of system 100. In an embodiment, the display for portable controller 108 is capable of receiving video and/or audio from the other system components. In an embodiment, portable controller 108 includes a flash ROM that enables wireless downloads and/or uploads. [0034] Television 104 is a conventional television. In an embodiment, television 104 is enhanced to support interactive and/or personal services. [0035] Personal services include virtual recording, programming, pausing/rewinding live broadcasts, or the like. For example, television 104 can be a personal television enhanced to support the MSN® TV service, hosted by WebTV Networks, Inc. (Mountain View, Calif.), that supports the WEBTV® services available from Microsoft Corporation (Redmond, Wash.). As shown, television 104 can be connected to cable set-top box 118, DSS set-top box 120, and/or media player 116 (e.g., PVR, VCR, or DVD player). [0036] The aforementioned system components are not intended to be exhaustive. Other devices (including appliances), applications, and/or the like can be implemented, including, but not limited to, a refrigerator, stove, microwave, toaster, coffee-maker, alarm clock, humidifiers, sprinkler system, lighting, light dimmers, etc. In an embodiment, portable controller 108 controls the operations and/or functions of such components, such as on/off, timers, modulation (e.g., oven temperatures, etc.), pause, snooze, etc. [0037] As discussed, communications network 180 provides a transmission medium for communicating among the system components. Communications network 180 is a wired and/or wireless local area network (LAN). Thus, communications network 180 includes wired, wireless, or both transmission media, including satellite, terrestrial (e.g., fiber optic, copper, UTP, STP, coaxial, hybrid fiber-coaxial (HFC), or the like), radio, microwave, free-space optics, and/or any other form or method of transmission. [0038] In embodiments, a server polices all traffic among the other system components. As such, the exchange of information among the system components is routed or otherwise controlled via a server. In another embodiment, communications network 180 supports peer-to-peer communications. As such, the system components exchange audio, video, voice, other data, and/or control messages directly with each other and without being centrally managed by a server. [0039] In an embodiment using a wired transmission medium, communications network 180 is an Ethernet LAN having a CAT-5 cable, or the like, distributed to each system component, such as television 104, media player 116, etc. The system component includes an audio/video (AV) connector that is responsive to receive the cable. In an embodiment, communications network 180 includes a telephone line and/or powerline (such as, the communications technologies made available from the Home Phone Networking Alliance (HomePNA) or the like). [0040] In an embodiment using a wireless transmission medium, communications network 180 supports the IEEE standard 802.11(a), which specifies a wireless Ethernet protocol for large-sized video. In another wireless embodiment, communications network 180 supports the IEEE standard 802.11(b), which specifies a wireless Ethernet protocol for small-size video. In another wireless embodiment, communications network 180 supports the IEEE standard 802.11(g). In another embodiment, the BLUETOOTH™ wireless technology (developed by Bluetooth SIG, Inc.) is used to support short-range wireless interfaces with system 100. [0041] As shown in FIG. 1, communications network 180 includes a wireless network access point 182, such as those available from Linksys Group Inc. (Irvine, Calif.) or Cisco Systems, Inc. (San Jose, Calif.), as a platform for the system components. A wireless access point 182 provides a central point for connectivity in a wireless network and always-on connectivity necessary for tracking states of the system components. Additionally, a wireless access point 182 can provide a connection point between a wired and wireless network. In an embodiment using a server, as discussed above, a wireless access point 182 serves as a platform for the server. In alternative server-based embodiments of the present invention, the server can actually be located on a number of different device platforms in addition to a wireless access point (such as, wireless access point 182 shown at 180), including a bridge device (such as, bridges 130(a)-130(e)), a personal digital assistant (such as, 108), a personal computer (such as, 106), or the like. [0042] System 100 also includes a plurality of infrared/serial bridges 130(a)-130(d), which comply with the IEEE 802.11(b) standard for wireless communications. Each infrared/serial bridge 130 interacts with one or more components. As shown, infrared/serial bridge 130(a) interacts with television 104(a), cable box 118, and media player 116. Infrared/serial bridge 130(b) interacts with tuner 114 or any type of proprietary device that rely on infrared/serial communication protocols as would be apparent to one skilled in the relevant art(s). Infrared/serial bridge 130(c) interacts with thermostat 112. Infrared/serial bridge 130(d) interacts with lighting device 110. A wireless-Ethernet bridge 130(e) interacts with television 104(b) and a DSS box 120. Wireless-Ethernet bridge 130(e) can support any IP addressable device. As such, television 104(b) and DSS box 120 are “next generation” UPnP devices that have IP addresses. [0043] Therefore, the present invention can integrate legacy devices (e.g., consumer electronic (CE) devices that rely on infrared/serial communication protocols), as well as UPNP™ devices and applications defined by the Universal Plug and Play (UPNP) Forum, as system components. An example of a controlled environment implementing an IEEE 802.11(b) infrared/serial bridge is described in the application entitled “Legacy Device Bridge for Residential or Non-Residential Networks” (U.S. patent application Ser. No. 10/387,590; filed Mar. 14, 2003), which is incorporated herein by reference as though set forth in its entirety. [0044] As described above, portable controller 108 (such as, a digital personal assistant, wireless notepad, etc.) enables a user to remotely alter the configuration and performance of other devices and/or applications from any location within the controlled environment. In an embodiment, portable controller 108 is a handheld platform having a graphic display that has wireless connectivity to a central server that can control the other devices and/or applications within a controlled environment via a wireless communications network 180 (e.g., as specified by IEEE standard 802.11b). In another embodiment, the server is built into portable controller 108. In another embodiment, portable controller 108 communicates directly with the other devices and/or applications via infrared (IR) code signals. [0045] In an embodiment, the present invention facilitates control of a system comprising an output system component (e.g., a television, a monitor, a speaker, etc.) having multiple input system components (e.g., DVD, VCR, satellite tuner, digital video recorder, stereo, etc.). In accordance with the present invention, the user first selects the output component via the GUI presented on portable controller 108. The user is then presented with a control screen affording the user with the ability to select a specific input component using a “tabbed” interface. When that input is selected, the control screen for that component is presented. [0046] FIG. 2 illustrates a hierarchical control interface 200 in accordance with an embodiment of the present invention. Control interface 200 is based on a hierarchical representation of a controlled environment (e.g., a user's house) with underlying interface sublevels corresponding to rooms in the controlled environment, and then system components in each of the rooms. As suggested by the interface level identification field 202, control interface 200 enables a user to select a room to control the system components located within the room. [0047] Control interface 200 includes several control objects, which are associated with a sequence of executable commands. The control objects include a home object 210, inter-level navigational object 212, intra-level navigational objects 208 a-208 b, and a plurality of room control objects 206 a-206 n. [0048] When activated, home object 210 presents a user with a global or “housewide” control screen, such as control interface 600 that is shown and described below with reference to FIG. 6. Referring back to FIG. 2, control screen 204 is the primary control screen presented to the user, and allows the user to view a plurality of room control objects 206 a-206 n, which correspond to the rooms in the controlled environment. Each room control object 206 a-206 n corresponds to one of the rooms, and is associated with executable commands that retrieve an underlying interface sublevel to display a screen that identifies the controllable system components located within the room. By activating one of the room control objects 206 a-206 n, a user thereby is able to select a particular room for purposes of controlling the system components contained in that room. [0049] Intra-level navigational objects 208 a-208 b are activated to horizontally scroll screen 204. If all room control objects 206 a-206 n are not visible in a current view, navigational objects 208 a-208 n scrolls screen 204 to bring the non-visible control objects 206 a-206 n into view. [0050] Inter-level navigational object 212 enables the user to move from one interface sublevel to the next. For example, if the user activates a room control object 206 to access a lower level view, the user can activate inter-level navigational object 212 to return the next higher level. [0051] As discussed above, when a room control object 206 a-206 n is activated, a control screen for the corresponding room is presented. FIG. 3 illustrates an embodiment of a room control screen 300 that is presented by portable controller 108 upon activation of a room control object 206 a-206 n. Room control screen 300 provides control options for controlling a family room as shown in the interface level identification field 302. [0052] Room control screen 300 includes a video control object 304 a, an audio control object 304 b, a lighting control object 304 c, and an environment control object 304 d. Video control object 304 a is associated with executable commands for controlling a video system in the room. Audio control object 304 b is associated with executable commands for controlling an audio system in the room. Lighting control object 304 c is associated with executable commands for controlling room lighting. Environmental control object 304 d is associated with executable commands for controlling a HVAC system in the room. Additional control objects can be included to control other types of devices and/or applications within a specific room. [0053] As discussed above, inter-level navigational object 212 allows the user to switch to the next higher interface level. For example, the next higher level for control screen 300 is top-level control screen 200. [0054] Switch object 306 is associated with executable commands to turn-on or turn-off all system components within the room. Therefore, all system components within the room can be turned-on or turned-off with one click, or more specifically, with the activation on one control object (i.e., switch object 306). [0055] As discussed above, when a component control object (such as, control objects 304 a-304 d) is activated, a control screen for the corresponding system component is presented. FIG. 4 illustrates component control screen 400 according to an embodiment of the present invention. Specifically, component control screen 400 is presented when a user activates video control object 304 a from FIG. 3. Component control screen 400 displays a control panel for controlling a television, which is a parent or primary system component for the video system in the room. Parent icon 402 is highlighted to designate the system component as being a parent system component. Parent icon 402 can be highlighted by being displayed at a brighter intensity or by a specific color, such as green. Parent icon 402 is not highlighted if the system component is a child or affiliate system component. [0056] The control panel for component control screen 400 includes a numerical channel pad 416, a pad enter activator 420, an on-screen menu display activator 406, and an on-screen menu navigator/selector 414. Control screen 400 also includes several specialized control objects, such as a favorite channels object 418, display object 408, electronic guide object 410, and a last channel object 412. [0057] Switch object 404 is associated with executable commands to turn-on or turn-off the television/parent system component. Inter-level navigational object 212 allows the user to switch to the next higher interface level. For example, the next higher level for component control screen 400 is room control screen 300. [0058] Component control screen 400 also includes a side tab 422 in the form of a scrollable field that graphically shows the children system components that are connected to the parent system component. The children system components are represented by children component control objects 426 a-426 n. FIG. 4 shows three children component control objects, namely a DVD control object 426 a for controlling a DVD player, a VHS control object 426 b for controlling a VHS player, and a PVR control object 426 c for controlling a PVR player, such as a TIVO® digital video recorder (DVR) available from TiVo Inc. (USA). Other children component control objects 426 a-426 n can be revealed by scrolling up or down side tab 422 by activating up navigational object 424 a and down navigational object 424 b. [0059] In an embodiment, component control screen 400 is customized as appropriate for portable controller 108. For example, the screen shown in FIG. 4 can be used with a Philips IPRONTO® device available from Philips Consumer Electronics, which has hard buttons (not shown) for certain basic functions such as volume. As such, the control screens of the present invention can include a combination of soft keys and hard keys for designated functions, such as volume. [0060] As discussed above, when a child component control object 426 a-426 n is activated, a control screen for the corresponding system component is presented. FIG. 5 illustrates a component control screen 500 that is produced from the activation of a child component control object 426 a-426 n according to an embodiment of the present invention. Component control screen 500 displays the control options for a DVD player. For example, if a user desires to watch a movie playing on the DVD player, the user can activate DVD player object 426 a, whereupon DVD component control screen 500 is displayed. DVD control object 426 a is highlighted to inform the user that the control screen for the DVD player has been selected. The other children component control objects 426 b-426 n are not highlighted. [0061] DVD component control screen 500 displays the options for controlling the functions of the DVD player. The options include a rewind object 510, a skip back object 512, a skip-forward object 522, a fast-forward object 524, a play object 528, a slow play object 518, a pause object 516, and a stop object 520. Chapter navigator 508 allows the user to select specific chapters in the digital recording. DVD component control screen 500 also includes an on-screen menu display activator 506 and an on-screen menu navigator/selector 514. [0062] Parent icon 402 is not highlighted on control screen 500 because the system component that is controlled by control screen 500 is a child system component. Switch object 504 is associated with executable commands to turn-on or turn-off the DVD player. Inter-level navigational object 212 allows the user to switch to the next higher interface level. For example, the next higher level for child-component control screen 500 is parent-component control screen 400. [0063] As described above, the user interface for portable controller 108 can be organized in a hierarchical layout. However, the layout is not restricted to a house-room hierarchy. In an embodiment, the user interface organizes the system components by component type for ease of control. FIG. 6 illustrates an embodiment of a control interface 600 that is based on a component-type control hierarchy. Control interface 600 provides options for aggregating the control of all system components matching a specific component type as shown in the interface level identification field 602. The underlying interface sublevels correspond to the types of system components that are located throughout the controlled environment. Control interface 600 includes six component-type control objects 604 a-604 f, which represent six types of system components within the controlled environment. Specifically, all available lighting systems are linked and grouped to lighting component-type control object 604 a. All environmental/comfort systems are linked and grouped to environmental component-type control object 640 b. The available audio components are grouped and linked to an audio component-type control objects 604 c-604 d. The alarm components for the safety/security systems are linked and grouped to safety/security component-type control object 604 e. Finally, the video components for the safety/security systems are grouped and linked to safety/security component-type control object 604 f. [0064] Switch object 606 is associated with executable commands to turn-on or turn-off all system components matching a specific component type. For example, if lighting component-type control object 604 a is selected, switch object 606 can be activated to turn-on or turn-off lighting systems that are linked to control object 604 a. Control object 604 a can be “selected” by using a mouse or similar input component to place a cursor over control object 604 a and right-click, or left-click, the mouse once. A double left-click can be used to “activate” control object 604 a. If using a touch screen, a single tap can be used to select a control object and a double tap can be used to activate the object. Pull-down menus can also be used to distinguish between the “selection” and “activation” of a control object. [0065] Activation of a component-type control object 604 a-604 f sends commands to present the next underlying interface sublevel, which identifies all available system components matching the corresponding component type. [0066] FIG. 7 illustrates an embodiment of a lighting control screen 700 that displays all controllable lighting in the controlled environment house. A plurality of lighting control objects 706 a-706 n are associated with the lighting systems in each room of the controlled environment. If more than one lighting system (e.g., lamp, over-head lighting, etc.) is located in a room, the activation of a lighting control object 706 a-706 n calls a sublevel screen that displays the various lighting systems within the corresponding room. In an embodiment, the activation of a lighting object 706 a-706 n (by, for example, double-clicking the object or double-tapping) calls a sublevel screen that displays the available control options for the lighting system. The control options includes dimming, timer-controls, and the like. [0067] Switch object 708 is associated with executable commands to turn-on or turn-off a lighting system(s) associated with a lighting control object 706 a-706 n. In an embodiment, a user would operate an input component to select one or more lighting control objects 706 a-706 n and then select switch object 708 to operate the associated lighting systems. In an embodiment, a user could turn-on or turn-off all lighting in, for example, a house with switch object 708, which can operate as a housewide “all lighting off” or “all lighting on” switch. [0068] Intra-level navigational objects 208 a-208 b are activated to scroll screen 704 to bring non-visible lighting control objects 706 a-706 n into view. Inter-level navigational object 212 allows the user to switch to a next higher interface level. For example, the next higher level for lighting control screen 700 is component-type hierarchical control interface 600. [0069] In an embodiment, lighting control objects 706 a-706 n are highlighted (e.g., intensity, color, or the like) to indicate that a lighting system is on or off. [0070] As such, the control interfaces of the present invention gives a user a convenient, visible indication of which system components (e.g., lights, televisions, security cameras, oven, etc.) are on/off in the controlled environment. Moreover, the visible indication can be provided on a single screen or a single scrollable screen, depending on the quantity of control objects. This affords the user with the ability to control these components using one master screen, rather than controlling lighting on a room-by-room basis, which would require the user to navigate through several room control screens. For example, in FIG. 7, the lights in the Family Room and Garage Lights are indicated as being in the “on” state. The user can turn the lights off in those rooms by deactivating the corresponding lighting control object 706 a-706 n or turn the lights on in any other room of the house by activating the lighting control object 706 a-706 n corresponding to the room. [0071] The present invention supports various protocols for displaying hierarchical control interfaces for controlling a plurality of system components within a controlled environment. Referring to FIG. 8, flowchart 800 represents the general operational flow of an embodiment for displaying control interfaces. More specifically, flowchart 800 shows an example of a control flow for presenting a hierarchical control interface based on a room hierarchy. [0072] Referring to FIG. 8, the control flow of flowchart 800 begins at step 801 and passes immediately to step 803. At step 803, a control screen is accessed and presented for display. The control screen displays all available rooms within a controlled environment. An example of a room-based hierarchical control screen is described above with reference to control screen 200 in FIG. 2. Control screen 200 displays the available rooms as control objects 20 a-20 n. However, the available rooms can also be presented as a hypertext-based list. Each room specified in the list or associated with a control object 20 a-20 n is linked to an underlying screen, which identifies the controllable system components within the room. [0073] At step 806, a room control screen is accessed and presented to display the one or more system components that are located within a selected room. [0074] The room control screen is accessed in response to the activation of a corresponding control object 20 a-20 n or the like, as discussed at step 803. [0075] An example of a room control screen is described above with reference to room control screen 300 in FIG. 3. A room control screen displays all available system components as component control objects 30 a-30 d or in a hypertext-based list, both of which are linked to an underlying screen. The underlying screen identifies the control options for the associated system component. [0076] At step 809, a component control screen is accessed and presented to display the control options for an associated system component. As discussed, the component control screen is accessed in response to the activation of a corresponding component control object 30 a-30 d or the like. The component control screen enables a user to select various control options to manage the operations and/or functions of a system component. Examples of a component control screen are described above with reference to component control screens 400 and 500 in FIG. 4 and FIG. 5. [0077] At step 812, the system component associated with the component control screen is checked to determine whether it is a parent system component. If it is, control passes to step 815. Otherwise, control passes to step 821. [0078] At step 815, all affiliate or children system components are displayed on the same component control screen to provide the user with an opportunity to control additional system components. For example, if the system component selected and controlled at step 809 is a parent system component (e.g., television), the user is able to control and/or setup an affiliate system component (e.g., DVD player) at step 812. [0079] At step 818, if an affiliate system component is available and desired to be controlled, the control flow returns to step 809, where a component control screen for a selected affiliate system component is presented for display. The child component control screen is accessed in response to the activation of a corresponding affiliate component control object 426 a-426 n or the like. The operations and/or functions of the affiliate system component is managed via this control screen. As described above with reference to FIG. 4 and FIG. 5, component control screen 500 represents a control interface for controlling an affiliate system component of the parent system component controlled by component control screen 400. [0080] If, on the other hand, no affiliate system component has been selected for controlling, the control flow passes to step 821. [0081] At step 821, the specified control options are executed to control the associated system component(s). For example, if a parent and child system component has been programmed to play a DVD recording, the associated commands are executed to transmit control signals to the respective system components, e.g. television/parent and DVD player/child. After the control interfaces have been setup and executed, the control flow ends as indicated at step 895. [0082] Referring to FIG. 9, flowchart 900 represents the general operational flow of another embodiment for displaying control interfaces. More specifically, flowchart 900 shows an example of a control flow for presenting a hierarchical control interface based on a component-type control hierarchy. [0083] Referring to FIG. 9, the control flow of flowchart 900 begins at step 901 and passes immediately to step 903. At step 903, a control screen is accessed and presented for display. The control screen displays all available component-types that are available within a controlled environment. An example of a component-type-based hierarchical control screen is described above with reference to control interface 600 in FIG. 6. Control interface 600 displays the available component types as control objects 604 a-604 f. However, the available component-types can also be presented as a hypertext-based list. Each component type (specified in a list, control object, or the like) is linked to an underlying screen, which identifies the controllable system components associated with a respective component type. [0084] At step 906, a component-type control screen is accessed and presented to display the one or more system components matching a selected component type by location (e.g., room). The component-type control screen is accessed in response to the activation of a corresponding control object 604 a-604 f or the like, as discussed at step 903. An example of a component-type control screen is described above with reference to component-type control screen 700 in FIG. 7. A component-type control screen displays all available system components as component control objects 706 a-706 n or in a hypertext-based list, both of which are linked to an underlying screen. The underlying screen identifies the control options for the associated system component. [0085] At step 909, a component control screen is accessed and presented to display the control options for an associated system component. As discussed, the component control screen is accessed in response to the activation of a corresponding component control object 706 a-706 n or the like. The component control screen enables a user to select various control options to manage the operations and/or functions of a system component. Examples of a component control screen are described above with reference to component control screens 400 and 500 in FIG. 4 and FIG. 5. [0086] At step 912, the system component associated with the component control screen is checked to determine whether it is a parent system component. If it is, control passes to step 915. Otherwise, control passes to step 921. [0087] At step 915, all affiliate system components are displayed on the same component control screen to provide the user with an opportunity to control additional system components. For example, if the system component selected and controlled at step 909 is a parent system component (e.g., television), the user is able to control and/or setup an affiliate or child system component (e.g., DVD player) at step 912. [0088] At step 918, if an affiliate system component is available and desired to be controlled, the control flow returns to step 909, where a component control screen for a selected child or affiliate system component is presented for display. The child component control screen is accessed in response to the activation of a corresponding child component control object 426 a-426 n or the like. The operations and/or functions of the child system component is managed via this control screen. As described above with reference to FIG. 4 and FIG. 5, component control screen 500 represents a control interface for controlling an affiliate system component of the parent system component controlled by component control screen 400. [0089] If, on the other hand, no affiliate system component has been selected for controlling, the control flow passes to step 921. [0090] At step 921, the specified control options are executed to control the associated system component(s). For example, if a parent and child system component has been programmed to play a DVD recording, the associated commands are executed to transmit control signals the respective system components, e.g. television/parent and DVD player/child. After the control interfaces have been setup and executed, the control flow ends as indicated at step 995. [0091] The present invention includes various control screens that enable a user to add and/or configure a system component for the controlled environment. In an embodiment, a set-up wizard is provided to allow a user to add or configure system components. FIG. 10 illustrates a definition control screen 1000 in accordance with an embodiment of the present invention. Definition control screen 1000 can be included as part of a set-up wizard for adding and/or configuring a system component, as indicated in definition field 1002. Control screen 1000 includes a plurality of control fields that are populated by a user. As shown, the control fields include a type field 1004, a manufacturer field 1006, a model field 1008, a room field 1010, a network extender field 1012, a display field 1014, an exclusion field 1016, and a name field 1018. [0092] Type field 1004 specifies the component type. As discussed above, a component-type hierarchical control display, such as control interface 600 and control screen 700, organizes the system components within a controlled environment by component type, and thereby, allow user to control all system components matching a specific component type from the same screen. Type field 1004 enables a user to specify the component type that supports the above-described hierarchical control user interfaces that are based on component type. An exemplary list of component types is shown in FIG. 11, which illustrates another embodiment of control screen 1000. In FIG. 11, type field 1004 shows that the component type can be an amplifier, an audiotron, a cable box, a DSS box, a DVD player, a lighting system, a thermostat, a PVR device, or a television. The list in type field 1004 is not exhaustive. Other system component types can be specified and included in the present invention, including but not limited to, a video server, messaging system, security or perimeter cameras, residential appliances, and the like. [0093] Referring back to FIG. 10, manufacture field 1006 enables a user to specify a manufacturer of the system component, and model field 1008 enables a user to specify a model number for the system component. In an embodiment, one or more software modules are associated with the control interfaces of the present invention, and query a lookup table, database, or the like for IR codes that are transmitted to control a system component. The information specified in manufacture field 1006 and model field 1008 is used by the software module(s) to query the database or the like. [0094] Room field 1010 specifies the room or region of the controlled environment, where the system component is located. The information in room field 1010 is used to support the room-based hierarchical control displays of the present invention (e.g., control interface 200 and control screen 300). Although this information can be initially specified by the user via a set-up wizard, the content of room field 1010 can also be initially set or dynamically updated by positioning unit 102. Examples of dynamically tracking the location of system components within a controlled environment is described in greater detail in the application entitled “Method, System, and Computer Program Product for Managing Controlled Residential or Non-Residential Environments” (U.S. patent application Ser. No. 10/382,897), and the application entitled “Method, System, and Computer Program Produce for Managing Controlled Residential or Non-Residential Environments,” (U.S. patent application Ser. No. 10/180,500). [0095] A Name field 1018 is included to allow a user to customize the name for the system component. The user can specify a personalized descriptor for easy recall. [0096] Definition control screen 1000 also includes a network extender field 1012, which allows a user to associate the system component with an appropriate bridge. As described above with reference to FIG. 1, an infrared/serial bridge 130 can be coupled to a system component to support wireless communications with other system components. As discussed, system 100 can have a plurality of infrared/serial bridges 130(a)-130(e) (e.g., one per stack or one per room). [0097] Display field 1014 allows a user to incorporate and/or configure one or more “hidden” affiliate system components that are linked to a parent system component. Hidden system components (such as, amplifiers) are configured into system 100, but the control screens (e.g., control screen 400) of the present invention can be configured to not present hidden affiliate system components to the user, because hidden affiliate system components operate invisibly to the user. Nonetheless, hidden affiliate system components are linked to one or more other parent system components. For example, an amplifier can be linked to a television, DVD player, and CD player. The amplifier would be automatically activated when either of these parent system components is selected through screen 1000. Volume controls, for example, that are established for these parent system components would be automatically redirected to the hidden amplifier. Accordingly, display field 1014 gives the user the ability to choose whether to see an affiliate system component on the component control screen (e.g., side tab 422 on control screen 400). In an embodiment, affiliate system components are displayed if the value of display field 1014 is “True,” and affiliate system components remain hidden from display if the value of display field 1014 is “False.”
[0098] Definition control screen 1000 also includes an exclusion field 1016, which allows a user to exempt a particular system component from an “ALL OFF” or “ALL ON” (Room or Home) command. As discussed above, switch objects 306, 606, and 708, for example, are associated with global commands that can be executed to turn-off or turn-on all system components (or all system components matching a specified component type) within a specific region, or within an entire controlled environment (e.g., system 100). However, exclusion field 1016 allows a user to exempt a particular system component, a particular type of system component, or system component(s) within a designated region, from these global commands. For example, the user can exclude a television in the living room from being turned-off when switch object 306 is activated. [0099] Control screen 1000 overlays the concept of device chains. When system components are configured in accordance with the present invention, a chain of related or affiliate system components (system components with input/output dependencies) is established. For example, one such chain can be a DVD player, amplifier, and television. Another chain can be a CD player and amplifier. A third chain can be a television and tuner. The present invention includes methodologies and/or techniques for turning-on or turning-off all system components in a chain (e.g., the amplifier turns-on when a CD player is initiated) and proxying control to the appropriate affiliate system components (e.g., volume requests go to the amplifier; or chapter selections go to the DVD player). [0100] Control screen 1000 also includes next object 1020, which calls the next control screen in the set-up wizard. Inter-level navigational object 212 recalls the previous screen within the set-up wizard. [0101] The control interfaces of the present invention provide a convenient and efficient manner for controlling a parent system component and its affiliate (including hidden) system components from a common platform. Referring back to FIG. 4, side tab 422 is a scrollable field that graphically shows the children control objects 426 a-426 n, which are associated with children system components. As described, the children system components are affiliated with the parent system component controlled by component control screen 400. In an embodiment, each individual child system component that comprises side tab 422 is configured by the user using a set-up wizard. The set-up wizard allows the user to specify the system components that are connected to a television/parent system component, and relay this information to the software modules supporting the control interfaces of the present invention. [0102] FIG. 12 illustrates a definition control screen 1200 that allows a user to specify affiliate system components to a parent system component, according to an embodiment of the present invention. Definition control screen 1200 enables specifications to be established for a tuner device as indicated in definition field 1202. Definition control screen 1200 includes a parent field 1204, input field 1206, audio device field 1208, audio input field 1210, and a digit entry field 1212. [0103] Parent field 1204 specifies whether the tuner device is a parent or child system component. If the system component is a parent system component, parent field 1204 contains the input “none.” If the system component is a child system component, parent field 1204 lists the name of the parent system component. [0104] Input field 1206 specifies the channel input. The channel input is used to tune the system component to receive and decode a video signal from the associated frequency channel. [0105] Audio field 1208 identifies whether an audio output system component is affiliated with the tuner device. For example, if the user intends for audio output to be feed to an auxiliary speaker system or audio amplifier, the system component name for the speaker system is entered in audio field 1208. In such case, the speaker system would be the child system component to the tuner/parent system component. [0106] Audio input field 1210 identifies the appropriate input channel on the speaker system that is specified in audio field 1208. [0107] Digit entry field 1212 specifies the quantity of digits that are needed to change channels on the tuner. For example, some tuners only accept two digits (i.e., limited to channels 01 to 99). Other tuners can accept up to four digits. The quantity of channel digits depends on the make and model of the system component (e.g., tuner) that is being configured. Therefore, digit entry field 1212 identifies metadata that describes the unique control behaviors of a system component. In an embodiment, portable controller 108 is programmable to extract this channel-digit metadata for the tuner from a metadata database. Examples of a system and method for extracting channel-digit metadata from a metadata database are described in the application entitled “Device Control Database,” (U.S. patent application Serial No. TBD; Attorney Docket No. 2100.0070000), which is incorporated herein by reference as though set forth in its entirety. However, if the metadata database does not contain such information, the channel-digit metadata is read from digit entry field 1212. Alternatively, digit entry field 1212 can be used to override the data stored in the metadata database. [0108] Next object 1020 calls the next control screen in the set-up wizard. Previous object 1222 calls the previous control screen. Inter-level navigational object 212 allows the user to switch to the next higher interface level with the set-up wizard. For example, if the user has configured a parent system component at one level, and is currently configuring an affiliate system component at a second, lower level, the user can return to the first level for the parent system component by activating navigational object 212, or the user can return to a previous screen for defining the affiliate system component at the second level by activating previous object 1222. [0109] FIG. 13 illustrates another embodiment of a definition control screen 1300 that allows a user to link affiliate system components to a parent system component. Definition control screen 1300 enables specifications to be established for an audio-video system component as indicated in definition field 1302. Control screen 1300 can be used to affiliate the audio-video system component to the tuner that is configured in control screen 1200. As such, control screen 1300 would represent a sub-layer level of control screen 1200. Thus, activation of inter-level navigational object 212 would call the next higher interface level, namely screen 1300. However, activation of previous object 1222 call a previous control screen in a series of control screens for configuring the audio-visual system component. [0110] FIGS. 1-13 are conceptual illustrations allowing an explanation of the present invention. It should be understood that embodiments of the present invention could be implemented in hardware, firmware, software, or a combination thereof. In such an embodiment, the various components and steps would be implemented in hardware, firmware, and/or software to perform the functions of the present invention. That is, the same piece of hardware, firmware, or module of software could perform one or more of the illustrated blocks (i.e., components or steps). [0111] Additionally, the present invention can be implemented in one or more computer systems or other processing systems, capable of carrying out the functionality described herein. Referring to FIG. 14, an example computer system 1400 useful in implementing the present invention is shown. Various embodiments are described in terms of this exemplary computer system 1400. After reading this description, it will become apparent to a person skilled in the relevant art(s) how to implement the invention using other computer systems and/or computer architectures. [0112] The computer system 1400 includes one or more processors, such as processor 1404. Processor 1404 can be a special purpose or a general purpose digital signal processor. The processor 1404 is connected to a communication infrastructure 1406 (e.g., a communications bus, cross-over bar, or network). [0113] Computer system 1400 can include a display interface 1402 that forwards graphics, text, and other data from the communication infrastructure 1406 (or from a frame buffer not shown) for display on the display unit 1430. [0114] Computer system 1400 also includes a main memory 1408, preferably random access memory (RAM), and can also include a secondary memory 1410. The secondary memory 1410 can include, for example, a hard disk drive 1412 and/or a removable storage drive 1414, representing a floppy disk drive, a magnetic tape drive, an optical disk drive, etc. The removable storage drive 1414 reads from and/or writes to a removable storage unit 1418 in a well-known manner. Removable storage unit 1418, represents a floppy disk, magnetic tape, optical disk, etc. which is read by and written to removable storage drive 1414. As will be appreciated, the removable storage unit 1418 includes a computer usable storage medium having stored therein computer software (e.g., programs or other instructions) and/or data. [0115] In alternative embodiments, secondary memory 1410 includes other similar means for allowing software and/or data to be loaded into computer system 1400. Such means include, for example, a removable storage unit 1422 and an interface 1420. Examples of such means include a program cartridge and cartridge interface (such as that found in video game devices), a removable memory chip (such as, an EPROM or PROM) and associated socket, and other removable storage units 1422 and interfaces 1420 which allow software and data to be transferred from the removable storage unit 1422 to computer system 1400. [0116] Computer system 1400 can also include a communications interface 1424. Communications interface 1424 allows software and/or data to be transferred between computer system 1400 and external devices. Examples of communications interface 1424 include a modem, a network interface (such as an Ethernet card), a communications port, a PCMCIA slot and card, etc. Software and data transferred via communications interface 1424 are in the form of signals 1428 which can be electronic, electromagnetic, optical or other signals capable of being received by communications interface 1424. These signals 1428 are provided to communications interface 1424 via a communications path (i.e., channel) 1426. Communications path 1426 carries signals 1428 and can be implemented using wire or cable, fiber optics, a phone line, a cellular phone link, an RF link, free-space optics, and other communications channels. [0117] In this document, the terms “computer program medium” and “computer usable medium” are used to generally refer to media such as removable storage unit 1418, removable storage unit 1422, a hard disk installed in hard disk drive 1412, and signals 1428. These computer program products are means for providing software to computer system 1400. The invention, in an embodiment, is directed to such computer program products. [0118] Computer programs (also called computer control logic or computer readable program code) are stored in main memory 1408 and/or secondary memory 1410. Computer programs can also be received via communications interface 1424. Such computer programs, when executed, enable the computer system 1400 to implement the present invention as discussed herein. In particular, the computer programs, when executed, enable the processor 1404 to implement the processes of the present invention, such as the method(s) implemented using, for example, portable controller 108, control screen 200, control screen 400, control screen 700, control screen 1000, and/or other system components of system 100 described above, such as methods 800 and/or 900, for example. Accordingly, such computer programs represent controllers of the computer system 1400. [0119] In an embodiment where the invention is implemented using software, the software can be stored in a computer program product and loaded into computer system 1400 using removable storage drive 1414, hard drive 1412 or communications interface 1424. The control logic (software), when executed by the processor 1404, causes the processor 1404 to perform the functions of the invention as described herein. [0120] In another embodiment, the invention is implemented primarily in hardware using, for example, hardware components such as application specific integrated circuits (ASICs). Implementation of the hardware state machine so as to perform the functions described herein will be apparent to persons skilled in the relevant art(s). [0121] In yet another embodiment, the invention is implemented using a combination of both hardware and software. [0122] While various embodiments of the present invention have been described above, it should be understood that they have been presented by way of example, and not limitation. It will be apparent to persons skilled in the relevant art(s) that various changes in form and detail can be made therein without departing from the spirit and scope of the invention. Moreover as previously discussed, it should be understood that the method, system, and computer program product of the present invention should not be limited to a residential environment. The present invention can be implemented in other types of environments having a central processing system for distributing media and sending command and/or control signals to a plurality of devices and/or applications dispersed throughout a designated region. In addition to a residence, the designated region includes, but is not limited to, office complexes, suite of small offices, production studios, warehouses, entertainment arenas, health care facilities, hotels, vacation resorts, aircrafts, ships, automobiles, or the like. Thus, the present invention should not be limited by any of the above-described exemplary embodiments, but should be defined only in accordance with the following claims and their equivalents. Patent CitationsCited PatentFiling datePublication dateApplicantTitleUS5414426 *Dec 11, 1992May 9, 1995Universal Electronics Inc.Favorite key macro command and chained macro command in a remote controlUS5519878 *Jul 15, 1994May 21, 1996Echelon CorporationSystem for installing and configuring (grouping and node address assignment) household devices in an automated environmentUS5537463 *May 31, 1994Jul 16, 1996Universal Electronics Inc.Magnetic modem in a remote controlUS5552917 *Sep 29, 1994Sep 3, 1996Universal Electronics Inc.Remote controlUS5570085 *Nov 22, 1994Oct 29, 1996Ludo A. BertschProgrammable distributed appliance control systemUS5689353 *Sep 3, 1996Nov 18, 1997Universal Electronics Inc.Remote control with two-way data couplingUS5802467 *Sep 28, 1995Sep 1, 1998Innovative Intelcom IndustriesWireless and wired communications, command, control and sensing system for sound and/or data transmission and receptionUS5805812 *May 15, 1996Sep 8, 1998Electronic Data Systems CorporationCommunication system for the remote control of equipmentUS5875108 *Jun 6, 1995Feb 23, 1999Hoffberg; Steven M.Ergonomic man-machine interface incorporating adaptive pattern recognition based control systemUS5898386 *Sep 5, 1996Apr 27, 1999Sony CorporationElectronic appliance system, electronic appliance and remote controllerUS5926108 *Feb 12, 1997Jul 20, 1999Sony CorporationMovie information pagerUS5930699 *Nov 12, 1996Jul 27, 1999Ericsson Inc.Address retrieval systemUS5953144 *Jun 16, 1997Sep 14, 1999Universal Electronics Inc.Upgradeable remote control deviceUS5956025 *Jun 9, 1997Sep 21, 1999Philips Electronics North America CorporationRemote with 3D organized GUI for a home entertainment systemUS5956487 *Oct 25, 1996Sep 21, 1999Hewlett-Packard CompanyEmbedding web access mechanism in an appliance for user interface functions including a web server and web browserUS5959751 *Jun 13, 1997Sep 28, 1999Universal Electronics Inc.Universal remote control deviceUS5963624 *Dec 5, 1997Oct 5, 1999Zilog, Inc.Digital cordless telephone with remote control featureUS6005861 *Mar 3, 1999Dec 21, 1999Samsung Electronics Co., Ltd.Home multimedia network architectureUS6020881 *Feb 18, 1997Feb 1, 2000Sun MicrosystemsGraphical user interface with method and apparatus for interfacing to remote devicesUS6026150 *Oct 30, 1997Feb 15, 2000EpigramNetwork protocol--based home entertainment networkUS6032202 *Jan 6, 1998Feb 29, 2000Sony Corporation Of JapanHome audio/video network with two level device controlUS6049711 *Aug 23, 1995Apr 11, 2000Teletrac, Inc.Method and apparatus for providing location-based information servicesUS6052750 *Jan 6, 1998Apr 18, 2000Sony Corporation Of JapanHome audio/video network for generating default control parameters for devices coupled to the network, and replacing updated control parameters therewithUS6085236 *Jan 6, 1998Jul 4, 2000Sony Corporation Of JapanHome audio video network with device control modules for incorporating legacy devicesUS6131028 *Dec 10, 1997Oct 10, 2000Integrated Telecom Solutions, Inc.Method of providing services specified by feature codes based upon location of a wireless telephone unitUS6148205 *Jun 30, 1998Nov 14, 2000Motorola, Inc.Method and apparatus for secure registration within an in-home wireless networkUS6154745 *Dec 23, 1997Nov 28, 2000Nokia Mobile Phones Ltd.Method for transmission of information to the userUS6167046 *Jan 9, 1998Dec 26, 2000Sharp Kabushiki KaishaCommunication method, communication system and computer readable recording medium recording communication programUS6170007 *Aug 31, 1999Jan 2, 2001Hewlett-Packard CompanyEmbedding web access functionality into a device for user interface functionsUS6198479 *Jun 24, 1998Mar 6, 2001Samsung Electronics Co., LtdHome network, browser based, command and controlUS6199136 *Sep 2, 1998Mar 6, 2001U.S. Philips CorporationMethod and apparatus for a low data-rate network to be represented on and controllable by high data-rate home audio/video interoperability (HAVi) networkUS6208341 *Aug 5, 1998Mar 27, 2001U. S. Philips CorporationGUI of remote control facilitates user-friendly editing of macrosUS6208866 *Dec 30, 1998Mar 27, 2001Ericsson Inc.System and method for location-based marketing to mobile stations within a cellular networkUS6218931 *Oct 8, 1999Apr 17, 2001Advanced Micro Devices, Inc.Home-appliance network with nodes identified by direct-sequence spreading codesUS6223348 *Sep 3, 1997Apr 24, 2001Universal Electronics Inc.Universal remote control systemUS6243707 *Jun 24, 1998Jun 5, 2001Samsung Electronics Co. Ltd.Method and apparatus for creating home network macrosUS6243772 *Jan 31, 1997Jun 5, 2001Sharewave, Inc.Method and system for coupling a personal computer with an appliance unit via a wireless communication link to provide an output display presentationUS6259707 *Oct 30, 1998Jul 10, 2001Sony CorporationSynchronizing a data driven interaction controller and a non-data driven interaction controllerUS6266612 *Jun 16, 1999Jul 24, 2001Trimble Navigation LimitedPosition based personal digital assistantUS6275865 *Nov 25, 1998Aug 14, 2001Sony Corporation Of JapanMethod and system for message dispatching in a home audio/video networkUS6282714 *Jan 31, 1997Aug 28, 2001Sharewave, Inc.Digital wireless home computer systemUS6288716 *Jun 24, 1998Sep 11, 2001Samsung Electronics, Co., LtdBrowser based command and control home networkUS6292554 *Oct 7, 1999Sep 18, 2001Simplified TelesysSystem and method for communicating with and controlling disparate telecommunications devices in a telecommunications networkUS6317028 *Feb 3, 1999Nov 13, 2001Electronic Security And Identification LlcElectronic identification, control, and security system and method for consumer electronics and the likeUS6317718 *Feb 26, 1999Nov 13, 2001Accenture Properties (2) B.V.System, method and article of manufacture for location-based filtering for shopping agent in the physical worldUS6321092 *Sep 15, 1999Nov 20, 2001Signal Soft CorporationMultiple input data management for wireless location-based applicationsUS6349352 *Jan 6, 1998Feb 19, 2002Sony Corporation Of JapanHome audio/video network with both generic and parameterized device controlUS6359636 *Jul 17, 1995Mar 19, 2002Gateway, Inc.Graphical user interface for control of a home entertainment systemUS6363434 *Mar 30, 1999Mar 26, 2002Sony Corporation Of JapanMethod of managing resources within a network of consumer electronic devicesUS6388399 *Jan 26, 2001May 14, 2002Leviton Manufacturing Co., Inc.Network based electrical control system with distributed sensing and controlUS6405261 *Nov 2, 2000Jun 11, 2002International Business Machines CorporationMethod and apparatus for an automatic multi-rate wireless/wired computer networkUS6463343 *Aug 10, 1999Oct 8, 2002International Business Machines CorporationSystem and method for controlling remote devices from a client computer using digital imagesUS6496135 *Jun 1, 2001Dec 17, 2002Universal Electronics Inc.Remote control with LED capabilitiesUS6563430 *Dec 11, 1998May 13, 2003Koninklijke Philips Electronics N.V.Remote control device with location dependent interfaceUS6587067 *Feb 23, 2001Jul 1, 2003Universal Electronics Inc.Universal remote control with macro command capabilitiesUS6600421 *Jul 31, 2001Jul 29, 2003Koninklijke Philips Electronics N.V.System to automatically locally control a device according to preferences of a user entering a local area of the device from a remote areaUS6642852 *Mar 1, 2002Nov 4, 2003Universal Electronics Inc.Remote control device with appliance power awarenessUS6680730 *Jan 25, 1999Jan 20, 2004Robert ShieldsRemote control of apparatus using computer networksUS6734879 *Sep 13, 2002May 11, 2004William H. Gates, IIIMethod and system for generating a user interface for distributed devicesUS6756998 *Oct 19, 2000Jun 29, 2004Destiny Networks, Inc.User interface and method for home automation systemUS6941356 *Jun 29, 2001Sep 6, 2005International Business Machines CorporationAutomated configuration enabled via interrogation over networkUS7027881 *Oct 29, 2002Apr 11, 2006Sony CorporationRemote control system, electronic device, and programUS7047092 *Apr 8, 2004May 16, 2006Coraccess SystemsHome automation contextual user interfaceUS7073130 *Jan 31, 2001Jul 4, 2006Microsoft CorporationMethods and systems for creating skinsUS7131058 *Oct 20, 2000Oct 31, 2006Silverbrook Research Pty LtdMethod and system for device controlUS7358956 *Mar 13, 2001Apr 15, 2008Microsoft CorporationMethod for providing feedback responsive to sensing a physical presence proximate to a control of an electronic deviceUS7360159 *Sep 18, 2003Apr 15, 2008Qarbon.Com, Inc.System for creating media presentations of computer software application programsUS7668990 *Jan 26, 2005Feb 23, 2010Openpeak Inc.Method of controlling a device to perform an activity-based or an experience-based operationUS20010018663 *Apr 30, 2001Aug 30, 2001Dussell William O.Position based personal digital assistantUS20010036192 *Mar 19, 2001Nov 1, 2001Chiles David ClydeHome-networkingUS20010041561 *Jan 12, 2001Nov 15, 2001Thomas VentulettSystem and method for location-based stimuli motivated information deliveryUS20010049275 *Feb 15, 2001Dec 6, 2001Pierry Cristiano L. S.Automated alert state change of user devices for time-based and location-based eventsUS20010049846 *Jun 13, 2001Dec 13, 2001Guzzi Brian DanielMethod and system for optimizing performance of consumer appliancesUS20010053274 *Jun 19, 2001Dec 20, 2001Koninklijke Philips Electronics N.V.System and method for remote control of consumer electronics over data network with visual feedbackUS20010054060 *Feb 1, 2001Dec 20, 2001Fillebrown Lisa A.Personal wireless networkUS20010055954 *Mar 29, 2001Dec 27, 2001Cheng Vernon S.Digital cordless telephone home networkUS20020006788 *May 7, 2001Jan 17, 2002Per KnutssonMethod and apparatus for a mobile access system delivering location based information and servicesUS20020019984 *Jul 3, 2001Feb 14, 2002Rakib Selim ShlomoHeadend cherrypicker with digital video recording capabilityUS20020022991 *Feb 15, 2001Feb 21, 2002Sharood John N.Building marketing systemUS20020031120 *Jul 3, 2001Mar 14, 2002Rakib Selim ShlomoRemote control for wireless control of system including home gateway and headend, either or both of which have digital video recording functionalityUS20020033760 *Sep 17, 2001Mar 21, 2002Shinji KobayashiPortable information divice, access device for portable information device, home network system, and home network access methodUS20020034292 *Aug 22, 2001Mar 21, 2002Tuoriniemi Veijo M.System and a method to match demand and supply based on geographical location derived from a positioning systemUS20020035403 *Jun 1, 2001Mar 21, 2002Tim ClarkMethod and apparatus for remotely monitoring and controlling a pool or spaUS20020035404 *Jun 11, 2001Mar 21, 2002Michael FiccoDevice control via digitally stored program contentUS20020035605 *Mar 16, 2001Mar 21, 2002Mcdowell MarkUse of presence and location information concerning wireless subscribers for instant messaging and mobile commerceUS20020035621 *Mar 16, 2001Mar 21, 2002Zintel William MichaelXML-based language description for controlled devicesUS20020036795 *Sep 7, 2001Mar 28, 2002Ricoh Company, Ltd.Printing apparatus and printing systemUS20020044042 *Apr 25, 2001Apr 18, 2002Christensen Carlos MeliaRF home automation system comprising nodes with dual functionalityUS20030011635 *Sep 13, 2002Jan 16, 2003William GatesMethod and system for generating a user interface for distributed devicesUS20030103088 *Nov 6, 2002Jun 5, 2003Universal Electronics Inc.User interface for a remote control applicationUS20040003073 *Mar 7, 2003Jan 1, 2004Openpeak Inc.Method, system, and computer program product for managing controlled residential or non-residential environmentsUS20040046677 *Sep 3, 2003Mar 11, 2004Universal Electronics Inc.Remote control device with appliance power awareness* Cited by examinerReferenced byCiting PatentFiling datePublication dateApplicantTitleUS7127305Jun 24, 2004Oct 24, 2006Eyecon Technologies, Inc.Method and apparatus for unified control of multiple devicesUS7548630 *Mar 11, 2004Jun 16, 2009Fraunhofer-Gesellschaft Zur Forderung Der Angewandten Forshcung E.V.Integrated loudspeaker systemUS8028283Mar 19, 2007Sep 27, 2011Samsung Electronics Co., Ltd.Method and system for automated invocation of device functionalities in a networkUS8090309Dec 31, 2007Jan 3, 2012Chestnut Hill Sound, Inc.Entertainment system with unified content selectionUS8150102 *Aug 27, 2008Apr 3, 2012Samsung Electronics Co., Ltd.System and method for interacting with a media device using faces and palms of video display viewersUS8195114Sep 27, 2010Jun 5, 2012Chestnut Hill Sound, Inc.Entertainment system with bandless content selectionUS8205013May 2, 2005Jun 19, 2012Samsung Electronics Co., Ltd.Method and system for aggregating the control of middleware control pointsUS8355690Oct 15, 2010Jan 15, 2013Chestnut Hill Sound, Inc.Electrical and mechanical connector adaptor system for media devicesUS8402150Jul 30, 2007Mar 19, 2013Automated Irrigation Controls, LLCManipulation of LonWorks® protocol for RF communicationsUS8433446Oct 21, 2009Apr 30, 2013Lennox Industries, Inc.Alarm and diagnostics system and method for a distributed-architecture heating, ventilation and air conditioning networkUS8437877Oct 21, 2009May 7, 2013Lennox Industries Inc.System recovery in a heating, ventilation and air conditioning networkUS8437878Oct 21, 2009May 7, 2013Lennox Industries Inc.Alarm and diagnostics system and method for a distributed architecture heating, ventilation and air conditioning networkUS8438503 *Sep 2, 2009May 7, 2013Universal Electronics Inc.System and method for enhanced command inputUS8442693 *Oct 21, 2009May 14, 2013Lennox Industries, Inc.System and method of use for a user interface dashboard of a heating, ventilation and air conditioning networkUS8452456Oct 21, 2009May 28, 2013Lennox Industries Inc.System and method of use for a user interface dashboard of a heating, ventilation and air conditioning networkUS8452906Oct 21, 2009May 28, 2013Lennox Industries, Inc.Communication protocol system and method for a distributed-architecture heating, ventilation and air conditioning networkUS8463442Oct 21, 2009Jun 11, 2013Lennox Industries, Inc.Alarm and diagnostics system and method for a distributed architecture heating, ventilation and air conditioning networkUS8463443Oct 21, 2009Jun 11, 2013Lennox Industries, Inc.Memory recovery scheme and data structure in a heating, ventilation and air conditioning networkUS8516372 *Oct 27, 2006Aug 20, 2013Harman Becker Automotive Systems GmbhMultimedia system for selecting and activating functionsUS8527096Oct 24, 2008Sep 3, 2013Lennox Industries Inc.Programmable controller and a user interface for sameUS8543243Oct 21, 2009Sep 24, 2013Lennox Industries, Inc.System and method of use for a user interface dashboard of a heating, ventilation and air conditioning networkUS8548630Oct 21, 2009Oct 1, 2013Lennox Industries, Inc.Alarm and diagnostics system and method for a distributed-architecture heating, ventilation and air conditioning networkUS8560125Oct 21, 2009Oct 15, 2013Lennox IndustriesCommunication protocol system and method for a distributed-architecture heating, ventilation and air conditioning networkUS8564400Oct 21, 2009Oct 22, 2013Lennox Industries, Inc.Communication protocol system and method for a distributed-architecture heating, ventilation and air conditioning networkUS8600558Oct 21, 2009Dec 3, 2013Lennox Industries Inc.System recovery in a heating, ventilation and air conditioning networkUS8600559Oct 21, 2009Dec 3, 2013Lennox Industries Inc.Method of controlling equipment in a heating, ventilation and air conditioning networkUS8605917 *Jul 20, 2007Dec 10, 2013Thales Avionics, Inc.Passenger control unit for an in-flight entertainment systemUS8615326Oct 21, 2009Dec 24, 2013Lennox Industries Inc.System and method of use for a user interface dashboard of a heating, ventilation and air conditioning networkUS8630293Jul 27, 2010Jan 14, 2014Acciona Solar PowerSolar power plant with scalable communications protocolUS8655303Sep 27, 2010Feb 18, 2014Chestnut Hill Sound, Inc.Entertainment system with sourceless selection including playlistsUS8655490Oct 21, 2009Feb 18, 2014Lennox Industries, Inc.System and method of use for a user interface dashboard of a heating, ventilation and air conditioning networkUS8655491Oct 21, 2009Feb 18, 2014Lennox Industries Inc.Alarm and diagnostics system and method for a distributed architecture heating, ventilation and air conditioning networkUS8661165Oct 21, 2009Feb 25, 2014Lennox Industries, Inc.Device abstraction system and method for a distributed architecture heating, ventilation and air conditioning systemUS8683345 *Jul 20, 2010Mar 25, 2014Lg Electronics Inc.Method and apparatus for displaying a control locking functionUS8694164Oct 21, 2009Apr 8, 2014Lennox Industries, Inc.Interactive user guidance interface for a heating, ventilation and air conditioning systemUS8713697Jul 9, 2008Apr 29, 2014Lennox Manufacturing, Inc.Apparatus and method for storing event information for an HVAC systemUS8725063Oct 15, 2010May 13, 2014Chestnut Hill Sound, Inc.Multi-mode media device using metadata to access media contentUS8725298Oct 21, 2009May 13, 2014Lennox Industries, Inc.Alarm and diagnostics system and method for a distributed architecture heating, ventilation and conditioning networkUS8744629Oct 21, 2009Jun 3, 2014Lennox Industries Inc.System and method of use for a user interface dashboard of a heating, ventilation and air conditioning networkUS8761945Aug 30, 2012Jun 24, 2014Lennox Industries Inc.Device commissioning in a heating, ventilation and air conditioning networkUS8762666Oct 21, 2009Jun 24, 2014Lennox Industries, Inc.Backup and restoration of operation control data in a heating, ventilation and air conditioning networkUS8774210Oct 21, 2009Jul 8, 2014Lennox Industries, Inc.Communication protocol system and method for a distributed-architecture heating, ventilation and air conditioning networkUS8788100Oct 21, 2009Jul 22, 2014Lennox Industries Inc.System and method for zoning a distributed-architecture heating, ventilation and air conditioning networkUS8798796Oct 21, 2009Aug 5, 2014Lennox Industries Inc.General control techniques in a heating, ventilation and air conditioning networkUS8802981Oct 21, 2009Aug 12, 2014Lennox Industries Inc.Flush wall mount thermostat and in-set mounting plate for a heating, ventilation and air conditioning systemUS8843092Oct 15, 2010Sep 23, 2014Chestnut Hill Sound, Inc.Method and apparatus for accessing media content via metadataUS8855825Oct 21, 2009Oct 7, 2014Lennox Industries Inc.Device abstraction system and method for a distributed-architecture heating, ventilation and air conditioning systemUS8863018 *Jan 28, 2008Oct 14, 2014Johnson Controls Technology CompanySystem and method for filter creation and use for building automation systemsUS8874815Oct 21, 2009Oct 28, 2014Lennox Industries, Inc.Communication protocol system and method for a distributed architecture heating, ventilation and air conditioning networkUS8892797Oct 21, 2009Nov 18, 2014Lennox Industries Inc.Communication protocol system and method for a distributed-architecture heating, ventilation and air conditioning networkUS8977794Oct 21, 2009Mar 10, 2015Lennox Industries, Inc.Communication protocol system and method for a distributed-architecture heating, ventilation and air conditioning networkUS8994539Oct 21, 2009Mar 31, 2015Lennox Industries, Inc.Alarm and diagnostics system and method for a distributed-architecture heating, ventilation and air conditioning networkUS9063537 *Sep 3, 2010Jun 23, 2015Alcatel LucentDevice for interaction with an augmented objectUS9081477 *May 20, 2011Jul 14, 2015Lg Electronics Inc.Electronic device and method of controlling the sameUS9086739 *May 6, 2013Jul 21, 2015Universal Electronics Inc.System and method for enhanced command inputUS9134815May 6, 2013Sep 15, 2015Universal Electronics Inc.System and method for enhanced command inputUS9141250 *Sep 7, 2011Sep 22, 2015Lg Electronics Inc.Mobile terminal and method for providing user interface using the sameUS9160814 *Apr 28, 2009Oct 13, 2015Intel CorporationIntuitive data transfer between connected devicesUS9225773Apr 3, 2014Dec 29, 2015Chestnut Hill Sound, Inc.Entertainment system with sourceless selection of networked and non-networked media contentUS9250715May 6, 2013Feb 2, 2016Universal Electronics Inc.System and method for enhanced command inputUS9261976May 6, 2013Feb 16, 2016Universal Electronics Inc.System and method for enhanced command inputUS9268345 *Oct 21, 2009Feb 23, 2016Lennox Industries Inc.System and method of use for a user interface dashboard of a heating, ventilation and air conditioning networkUS9294705Jun 27, 2008Mar 22, 2016Universal Electronics Inc.System and method for ubiquitous appliance controlUS9298334 *Feb 15, 2012Mar 29, 2016Marvell International Ltd.Method and apparatus for providing a user interface having a guided task flow among a plurality of devicesUS9323453May 6, 2013Apr 26, 2016Universal Electronics Inc.System and method for enhanced command inputUS9325517Oct 21, 2009Apr 26, 2016Lennox Industries Inc.Device abstraction system and method for a distributed-architecture heating, ventilation and air conditioning systemUS9335923May 6, 2013May 10, 2016Universal Electronics Inc.System and method for enhanced command inputUS9432208Oct 21, 2009Aug 30, 2016Lennox Industries Inc.Device abstraction system and method for a distributed architecture heating, ventilation and air conditioning systemUS9477402May 6, 2013Oct 25, 2016Universal Electronics Inc.System and method for enhanced command inputUS9490997Jan 28, 2014Nov 8, 2016Panasonic Intellectual Property Corporation Of AmericaControl method for information apparatus and computer-readable recording mediumUS9501757 *Aug 3, 2006Nov 22, 2016International Business Machines CorporationIdentifying remote objects on a client systemUS20050132305 *Dec 12, 2003Jun 16, 2005Guichard Robert D.Electronic information access systems, methods for creation and related commercial modelsUS20050190145 *Feb 24, 2004Sep 1, 2005Daryl HlasnyMethod and system for controlling legacy entertainment devices through a data networkUS20060147074 *Mar 11, 2004Jul 6, 2006Fraunhofer-Gesellschaft Zur Forderung Der Angewandten Forschung E.V.Integrated loudspeaker systemUS20060248233 *May 2, 2005Nov 2, 2006Samsung Electronics Co., Ltd.Method and system for aggregating the control of middleware control pointsUS20070124470 *Jan 25, 2006May 31, 2007Kazuo OokuboComputer for displaying parent object automatically and display method thereforeUS20070136778 *Dec 7, 2006Jun 14, 2007Ari BirgerController and control method for media retrieval, routing and playbackUS20070140187 *Dec 15, 2005Jun 21, 2007Rokusek Daniel SSystem and method for handling simultaneous interaction of multiple wireless devices in a vehicleUS20070183389 *Aug 3, 2006Aug 9, 2007International Business Machines CorporationMethod and System for Identifying Remote Objects on a Client SystemUS20070192109 *Nov 15, 2006Aug 16, 2007Ivc Inc.Voice command interface deviceUS20070200875 *Oct 27, 2006Aug 30, 2007Isabell SeegerMultimedia system for selecting and activating functionsUS20070220529 *Mar 19, 2007Sep 20, 2007Samsung Electronics Co., Ltd.Method and system for automated invocation of device functionalities in a networkUS20070279389 *May 31, 2006Dec 6, 2007Samsung Electronics Co., Ltd.Method of task-oriented universal remote control user interfaceUS20080046822 *Aug 15, 2006Feb 21, 2008Frank MeyerApparatus and method for interactive user software interface designUS20080157997 *Jul 20, 2007Jul 3, 2008Thales Avionics, Inc.Passenger control unit for an in-flight entertainment systemUS20080171539 *Jan 12, 2007Jul 17, 2008Nokia CorporationMobile communication terminal and methodUS20080209342 *Jan 28, 2008Aug 28, 2008Johnson Controls Technology CompanySystem and method for filter creation and use for building automation systemsUS20080215240 *Nov 5, 2007Sep 4, 2008Damian HowardIntegrating User InterfacesUS20080222565 *Jan 28, 2008Sep 11, 2008Johnson Controls Technology CompanyTask focused user interface systems and methods for building automation systemsUS20090125821 *Nov 8, 2007May 14, 2009Carolynn Rae JohnsonGraphical user interface feature for enabling faster discrete navigation among monitors in a multiple monitor workstationUS20090222270 *Nov 15, 2006Sep 3, 2009Ivc Inc.Voice command interface deviceUS20090300620 *Feb 18, 2009Dec 3, 2009Samsung Electronics Co., Ltd.Control device and method for providing user interface (ui) thereofUS20090327910 *Jun 27, 2008Dec 31, 2009Universal Electronics Inc.System and method for ubiquitous appliance controlUS20100054534 *Aug 27, 2008Mar 4, 2010Samsung Electronics Co., Ltd.System and method for interacting with a media device using faces and palms of video display viewersUS20100107111 *Oct 21, 2009Apr 29, 2010Lennox Industries Inc.System and method of use for a user interface dashboard of a heating, ventilation and air conditioning networkUS20100245259 *Mar 25, 2009Sep 30, 2010Honeywell International Inc.Small screen display with a data filtering and sorting user interfaceUS20100275135 *Apr 28, 2009Oct 28, 2010Dunton Randy RIntuitive data transfer between connected devicesUS20110055772 *Sep 2, 2009Mar 3, 2011Universal Electronics Inc.System and method for enhanced command inputUS20110069844 *Sep 27, 2010Mar 24, 2011Krampf Steven SEntertainment system with bandless content selectionUS20110106279 *Oct 28, 2010May 5, 2011Samsung Electronics Co., Ltd.Method and apparatus for controlling home network system using mobile terminalUS20110126116 *Jul 20, 2010May 26, 2011Min Soo LeeApparatus for controlling multimedia device and method for providing graphic user interfaceUS20110153087 *Jul 27, 2010Jun 23, 2011Acciona Solar Power, Inc.Solar power plant with virtual sun trackingUS20110153095 *Jul 27, 2010Jun 23, 2011Acciona Solar Power, Inc.Solar power plant with scalable field control systemUS20110160924 *Jul 27, 2010Jun 30, 2011Acciona Solar Power, Inc.Solar power plant with scalable communications protocolUS20110296339 *May 20, 2011Dec 1, 2011Lg Electronics Inc.Electronic device and method of controlling the sameUS20120089946 *Dec 19, 2011Apr 12, 2012Takayuki FukuiControl apparatus and script conversion methodUS20120243743 *Sep 3, 2010Sep 27, 2012Alain PastorDevice for interaction with an augmented objectUS20120260198 *Sep 7, 2011Oct 11, 2012Choi WoosikMobile terminal and method for providing user interface using the sameUS20120284652 *Jun 22, 2011Nov 8, 2012National Taiwan University Of Science And TechnologyHuman-environment interactive system and portable device using the sameUS20130043986 *Dec 15, 2011Feb 21, 2013Hon Hai Precision Industry Co., Ltd.Remote controller and remote control method using same having two control modes for controlling at least two different household electric appliancesUS20130073293 *Sep 20, 2011Mar 21, 2013Lg Electronics Inc.Electronic device and method for controlling the sameUS20130106738 *Jul 10, 2012May 2, 2013Lg Electronics Inc.Remote controller and method for operating the sameUS20130254721 *May 6, 2013Sep 26, 2013Universal Electronics Inc.System and method for enhanced command inputUS20130283182 *Dec 21, 2011Oct 24, 2013Saurabh DaduMechanism for facilitating proxy user interface-based remote management and control of computing and non-computing devicesUS20140033105 *Apr 18, 2013Jan 30, 2014Hon Hai Precision Industry Co., Ltd.Control system and method thereofUS20140359524 *Aug 19, 2014Dec 4, 2014Panasonic Intellectual Property Corporation AmericaMethod for controlling information apparatus and computer-readable recording mediumUSD747338 *May 24, 2013Jan 12, 2016Lg Electronics Inc.Television receiver with graphical user interfaceUSD749107 *Sep 24, 2013Feb 9, 2016Yamaha CorporationDisplay screen with animated graphical user interfaceUSD754178 *Aug 7, 2014Apr 19, 2016Huawei Technologies Co., Ltd.Display screen or portion thereof with a graphical user interfaceEP2504750A1 *Jun 16, 2010Oct 3, 2012LG Electronics Inc.Apparatus for controlling multimedia device and method for providing graphic user interfaceEP2504750A4 *Jun 16, 2010Oct 30, 2013Lg Electronics IncApparatus for controlling multimedia device and method for providing graphic user interfaceEP2634969A3 *Dec 13, 2012Sep 2, 2015RWE Effizienz GmbHMethod for operating a system for home automation and a home automation control systemEP2743826A1 *Aug 16, 2013Jun 18, 2014Samsung Electronics Co., LtdService providing device, and method of providing a user interfaceWO2009158335A1 *Jun 23, 2009Dec 30, 2009Universal Electronics Inc.System and method for ubiquitous appliance controlWO2010146174A2 *Jun 18, 2010Dec 23, 2010Archimede Solutions SarlSystem for accessing, controlling and managing heterogeneous communicating objectsWO2010146174A3 *Jun 18, 2010Mar 31, 2011Archimede Solutions SarlSystem for accessing, controlling and managing heterogeneous communicating objectsWO2011017121A1 *Jul 27, 2010Feb 10, 2011Acciona Solar Power, Inc.Scalable solar power plantWO2011062341A1Jun 16, 2010May 26, 2011Lg Electronics Inc.Apparatus for controlling multimedia device and method for providing graphic user interfaceWO2012094356A1 *Jan 4, 2012Jul 12, 2012Thomson LicensingContextual user interfaceWO2013050763A1 *Oct 4, 2012Apr 11, 2013Retrieva LimitedSafety system for tracking and managing the welfare of an individualWO2013065929A1 *Jul 23, 2012May 10, 2013Lg Electronics Inc.Remote controller and method for operating the sameWO2016055844A3 *Oct 2, 2015Jul 7, 2016Red Bend SoftwareMethod and apparatus for controlling devices in a personal environment using a portable computing device* Cited by examinerClassifications U.S. Classification715/851, 715/737, 715/771, 715/761, 715/779International ClassificationG06F3/00, H04Q, G06F3/048Cooperative ClassificationY10S715/97, H04L67/125, G06F3/0481, G06F9/4443, H04L12/282European ClassificationG06F3/0481, G06F9/44W, H04L29/08N11M, H04L12/28H3BLegal EventsDateCodeEventDescriptionFeb 23, 2004ASAssignmentOwner name: OPENPEAK INC., FLORIDAFree format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:KILLIAN, DAVID;HARTER, GLENN;FLORES, JUSTIN;AND OTHERS;REEL/FRAME:015026/0185;SIGNING DATES FROM 20040217 TO 20040218Owner name: OPENPEAK INC., FLORIDAFree format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:KILLIAN, DAVID;HARTER, GLENN;FLORES, JUSTIN;AND OTHERS;SIGNING DATES FROM 20040217 TO 20040218;REEL/FRAME:015026/0185May 7, 2012ASAssignmentOwner name: ID8 GROUP R2 STUDIOS, INC., CALIFORNIAFree format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:OPENPEAK INC.;REEL/FRAME:028167/0973Effective date: 20120123Mar 25, 2015FPAYFee paymentYear of fee payment: 4RotateOriginal ImageGoogle Home - Sitemap - USPTO Bulk Downloads - Privacy Policy - Terms of Service - About Google Patents - Send FeedbackData provided by IFI CLAIMS Patent Services