User interface conversion system and method capable of supporting various devices

The present invention relates to a user interface conversion system and method capable of supporting various devices. The user interface conversion system includes a control device for controlling predetermined devices residing on a home network, and a gateway for generating an integrated user interface based on neutral user interfaces of the devices residing on the home network at the request of a user for controlling the devices and converting the generated user interface into a specific user interface so that the integrated user interface can be supported in a specific client of the user.

This application claims the priority of Korean Patent Application No. 10-2003-0005568, filed on Jan. 28, 2003, in the Korean Intellectual Property Office, the disclosure of which is incorporated herein in its entirety by reference.

BACKGROUND OF THE INVENTION

1. Field of the Invention

The present invention relates to a user interface conversion system and method capable of supporting various devices, and more particularly, to a user interface conversion system and method capable of supporting various devices wherein an integrated user interface is generated based on neutral user interfaces residing on the home network and converted into a specific user interface such that the integrated user interface can be supported in a client. This application claims the priority of Korean Patent Application No. 10-2003-0005568, filed on Jan. 28, 2003, in the Korean Intellectual Property Office, the disclosure of which is incorporated herein in its entirety by reference.

2. Description of the Related Art

In general, a home network is configured using Internet Protocol (hereinafter referred to as “IP”) based private networks. Thus, various kinds of equipment used in a home, including all types of personal computers (PCs), intelligent appliances and wireless devices, are connected to one another and controlled through a single network.

A proposed home network system is configured in such a manner that a common virtual computing environment called middleware is established at the equipment residing in the private network and applications are provided on the computing environment. The middleware allows various kinds of equipment to communicate with one another in the home network. The currently available middleware includes home AV interoperability (HAVi), universal plug and play (UPnP), Jini, home wide web (HWW), and the like.

Various kinds of equipment residing on the home network are connected to one another in a peer-to-peer fashion through a home network middleware. The respective equipment uses IP addresses that are assigned by a dynamic host configuration protocol (hereinafter, “DHCP”) server or selected by an auto IP function.

That is, when the respective equipment is first connected to the home network, it searches for the DHCP server in order to obtain the address assigned in accordance with a response of the DHCP server or automatically selects the IP address within a certain range using the auto IP function in a case of a network in which the DHCP server does not operate.

The equipment by which the IP address assigned by the DHCP server or selected by the auto IP function is used can communicate with other equipment on the network using TCP/IP and perform searches and queries for the other equipment on the network via the respective IP addresses.

The home network middleware such as the UPnP uses the protocol such as sampling stochastic dynamic programming (hereinafter, “SSDP”) in order to search desired equipment in the home network. Further, in order to control the operation of the searched equipment, a web-based method is used in which a simple object access protocol (hereinafter, “SOAP”) is used to call a relevant control device or a control message is transmitted through a presentation web page.

FIG. 3illustrates an operation control process of accessing the UPnP control device residing in the conventional home network.

As shown inFIG. 3, a UPnP control point30searches for control devices such as the control device20for controlling various kinds of equipment on the UPnP home network (hereinafter, “UPnP CD”) using the SSDP and controls the UPnP CD20through a SOAP request using device information on the searched UPnP CD20obtained from the search of the UPnP CDs20using the SSDP. That is, the UPnP control point30controls the equipment by calling the UPnP CD20.

Alternatively, the UPnP control point30accesses a relevant control web page of the UPnP CD20through a web browser10using current uniform resource locator (URL) information corresponding to the control web page of the searched UPnP CD20obtained from the search of the UPnP CDs20using the SSDP. Then, the control point transmits an HTTP request corresponding to a control message for controlling specific equipment through the control web page provided on the web browser10to the UPnP CD20, and thus, confirms processing results for the HTTP request in the UPnP CD20. That is, if a user has access to the control web page of the UPnP CD20through the web browser10and selects a desired control message, an HTTP request message corresponding to the selected control message is transmitted to the UPnP CD20. Then, the process for the HTTP request is performed at the UPnP CD20and its resultant response is received by the user.

However, there is a problem in that devices such as mobile phones or PDAs, which recently gained wide public exposure but have limited computer performance and UI display capability, have difficulty in properly executing the web browser or displaying the HTML pages as they are.

Further, there is another problem in that the devices on the home network cannot be controlled in a case where the protocols supporting the middleware are not compatible with one another even though the middleware should be used for searching and controlling the device operating on the home network.

SUMMARY

The present invention is conceived to solve the aforementioned problems. An object of the present invention is to provide a user interface conversion system and method capable of supporting various devices, wherein an integrated user interface is generated based on neutral user interfaces for the devices and converted into a specific user interface for allowing the integrated user interface to be supported in a specific client, thereby enabling the support of various clients.

Another object of the present invention is to provide a user interface conversion system and method capable of supporting various devices, for enabling the access to devices on a home network through an integrated user interface.

According to an aspect of the present invention for achieving the objects, there is provided a user interface conversion system comprising a control device for controlling predetermined devices residing on a home network, and a gateway for generating an integrated user interface based on neutral user interfaces of the devices residing on the home network at the request of a user for controlling the devices and converting the generated user interface into a specific user interface so that the integrated user interface can be supported in a specific client of the user.

DESCRIPTION

FIG. 1is a block diagram schematically illustrating a user interface conversion system capable of supporting various devices according to the present invention. The user interface conversion system comprises a client of a user100, a gateway200, and a control device300.

The user100has access to the control device300through the client and controls a home network device. Here, it can be understood that the client of the user100is a computer, a notebook computer, a PDA, a mobile phone, or the like.

The gateway200generates an integrated user interface (UI), based on neutral UIs for the devices residing on the home network, at the request of the user100for controlling the devices and converts the integrated UI into a specific UI so that the integrated UI can be supported in the client of the user100. The gateway200comprises a protocol unit210, a device collection unit220, a device database230, an integrated UI generator240, and a UI conversion unit250.

The protocol unit210supports a protocol for searching the devices residing on the home network. Here, it can be understood that the protocol is SSDP, lookup service of Jini, or the like.

The device collection unit220collects the devices including the neutral UIs residing on the home network.

The device database230is configured to store device information collected from the device collection unit220. Here, the collected device information is meta information on the device, a URL used to access the neutral UI's, or the like.

The integrated UI generator240is configured to generate the integrated UI based on the device information stored in the device database230. That is, the integrated UI neutrally describes the UIs using an XML so that the integrated UI can be converted into one of many specific UI expressions.

The UI conversion unit250converts the integrated UI generated from the integrated UI generator240into the specific UI that can be supported in the client of the user100.

The control device300is configured to control the operations of the predetermined devices residing on the home network.

FIG. 2is a flowchart schematically illustrating a user interface conversion method capable of supporting the various devices according to the present invention.

When the user100requests the UI conversion unit250to transmit the UI for the devices on the home network which can be supported in user's own client, the UI conversion unit250first requests the integrated UI generator240to transmit the neutral UIs in response to the request of the user100.

Then, the integrated UI generator240requests the device collection unit220to transmit the neutral UI's collected in the device collection unit220, when receiving the request for transmission of the neutral UI's from the UI conversion unit250. Accordingly, the device collection unit220retrieves the collected neutral UI's for the devices that are stored in the device database230, and then, transmits the retrieved neutral UIs to the integrated UI generator240.

At this time, the neutral UIs are collected in the device collection unit220. This is performed in such a manner that the devices residing on the home network are searched through the SSDP and the neutral UI's for the devices are then collected. The device information collected from the device collection unit220(for example, the meta information about the devices, the URL information used to have access to the neutral UI's, or the like) is stored in the device database230. Further, the meta information about the devices (for example, the names of manufacturing companies, types of devices, versions, etc.) and positional information on the neutral UIs are stored in a table format in the device database230.

In the meantime, the neutral UIs may be collected in the device collection unit220either after or before the user100makes a request for the UI.

The integrated UI generator240generates the integrated UI based on the collected neutral UIs transmitted from the device collection unit220and then transmits the generated UI to the UI conversion unit250. Accordingly, the UI conversion unit250converts the integrated UI transmitted from the integrated UI generator240into a specific UI that can be supported in the client of the user100.

Thereafter, when the UI conversion unit250transmits the converted specific UI to the client of the user100, the integrated UI that has been converted into the specific UI is displayed on the client of the user100. The integrated UI displayed on the client can be expressed in the form of images, texts, or the like. Here, the texts may be expressed in the form of a hyperlink, a text box, a list or the like.

When the user100selects (or makes a request for) the UI of a device, which the user wishes to control, from the integrated UI (images or texts) displayed on the client of the user100, the UI conversion unit250requests the control device300to transmit the neutral UI for the device that the user100has selected (or requested).

Then, the control device300transmits the neutral UI for the specific device requested by the UI conversion unit250to the UI generator240which in turn generates the integrated UI based on the transmitted neutral UI for the device and transmits the generated UI to the UI conversion unit250.

Thereafter, the UI conversion unit250converts the integrated UI transmitted from the integrated UI generator240into the specific UI that can be supported in the client of the user100.

If the integrated UI, which has been converted into the specific UI so that it can be supported in the client of the user100, is displayed on the client of the user100, the user100can control the operation of the desired device using the integrated UI displayed thereon.

A method of controlling the device residing on the home network by the user according to an exemplary embodiment of the present invention will be hereinafter explained.

First, when the user100makes a request for the UI of the device residing on the home network which can be supported in his/her own client, the gateway200generates the integrated UI based on the collected neutral UIs and converts the generated UI into the specific UI so that the integrated UI can be supported in the client of the user100. Then, the gateway200causes the converted UI to be displayed on the client of the user100. Here, the integrated UI converted into the specific UI is supported in the form of the images or texts in the client of the user100. That is, the home network devices (for example, a refrigerator, TV, audio and the like) controllable by the user100are displayed in the form of the images or texts on the client of the user100.

When the user100selects (or makes the request for) the UI of the desired device (e.g., TV) from the integrated UI displayed on the client, the gateway200requests the control device300to transmit the neutral UI of the device (e.g., TV) selected (or requested) by the user100.

Then, the control device300transmits the requested neutral UI of the device (e.g., TV) to the gateway200. The gateway200generates the integrated UI based on the received neutral UI and converts the generated UI into the specific UI so as to display the specific UI on the client of the user100.

Thus, the user100can control the operation of the specific device (e.g., TV) residing on the home network through the integrated UI (e.g., volume control, channel change, power on/off, etc.) of the specific device (e.g., TV) which is displayed on the client.

Table 1 below is a table showing UI elements for expressing the neutral UIs of the present invention in the form of tags.

In Table 1 below, the tags are classified by double lines according to respective UI elements. In the respective elements, unindented tags are main roots and indented tags represent children elements with respect to the respective above main roots.

TABLE 1TagExplanationPanelIt seems to be a single HTML page because it includes a whole UI.ImageIt indicates information in the form of images. If a relevant devicecannot support the image, it should be replaced with texts.InformationIt corresponds to the information on the image.srcLocation where an actual figure will be downloaded, i.e., relative URLtextIt is a text displayed on the screen. If a relevant device cannot supportthe image, it should be replaced with texts.optionIt prescribes characteristics used for expressing the information.LabelIt indicates text information.informationIt corresponds to the information on the label.textIt is a text displayed on the screen.optionIt prescribes characteristics used for expressing the information.ListIt is a choice element for allowing one menu to be selected from one ormore menus.informationIt corresponds to the information on the list.idIt has a value for classifying the choice elements.actionURL that will be retrieved at the actual executionitemlistOne or more sets of menusitemIndividual menusactionmsgA value that is input when the user selectsvalueA value that corresponds to the actionmsg in an item selected by theuser and is actually transferredtextIt is a text displayed on the screen.optionIt prescribes characteristics used for expressing the information.TextboxIt receives strings from the user and executes the given operation.informationIt corresponds to the information on the textbox.idIt has a value for classifying the textboxes.textIt is a text displayed on the screen.actionURL that will be retrieved at the actual input executionoptionIt prescribes characteristics used for expressing the information.ButtonIt executes the given operation when the UI elements in the form ofimages or texts are selected.informationIt corresponds to the information on the button.srcLocation where an actual figure will be downloaded, i.e., relative URLtextIt is a text displayed on the screen. If a relevant device cannot supportthe image, it should be replaced with texts.actionURL that will be retrieved in order to execute the given operation whenthe image or text elements are selectedoptionIt prescribes characteristics used for expressing the information.Panel: It indicates a framework including the whole UI. Thus, all the individual UI elements are included in the panel.Image: It indicates information in the form of images. It is generally a URL and represents a location where the image is downloaded. Here, the types of images to be supported vary according to user interface displays.Label: It indicates information in the form of texts.Textbox: It receives strings from the user and executes the given operation.Button: It executes the given operation when the UI elements in the form of images or texts are selected.List: If one menu is selected from several menus, it executes the given operation in response to the selected menu.

ReferenceFIG. 1shown below is an example in which the operation control of the home network device is described with the neutral UIs with reference to Table 1.

A process of controlling a washing machine residing on the home network by the user100will be hereinafter explained in Table 2.

When the user100requests that the washing machine residing on the home network be controlled, the neutral UI in the form of images or texts capable of controlling the washing machine is displayed on the client of the user100.

If the user100selects the displayed washing machine, a UI stating “Select washing mode of the washing machine” is displayed on the client of the user100and another UI related to the selected washing mode (e.g., standard mode, quick mode, etc.) is also displayed thereon.

Thereafter, the next individual functions (e.g., boiling washing, spinning, number of rinse, hot/cold water setting, etc.) and time setting functions are displayed in response to arbitrary selection of the user100. If the user selects the “boiling washing” function, a UI on which a period of time needed for boiling the laundry can be input is displayed. Thus, the boiling function of the washing machine is performed during the time period inputted by the user100.

Thereafter, another UI in the form of images or texts, on which the other functions of the washing machine can be selected, is displayed on the client of the user100.

According to the present invention, the integrated UI is generated based on the neutral UIs of the devices residing on the home network and converted into the specific UI so that it can be supported in the specific client. Thus, there is an advantage in that a variety of clients can be supported.

Further, there is another advantage in that the user can have access to the devices residing on the home network through the integrated UI.

The present invention can be embodied as a computer readable program that can be run by a computer, and implemented in a digital computer using a computer readable recording medium. Here, the computer readable medium may be any recording apparatus including a magnetic storage medium, such as read-only memory (ROM), a floppy disk, and a hard disc, and an optical recording medium, such as CD ROM, and DVD). Also, the computer readable medium may be a carrier wave that transmits data via the Internet, for example.

The present invention has been described in detail in connection with an exemplary embodiment, but it will be apparent to those skilled in the art that various modifications or changes may be made thereto without departing from the spirit and scope of the invention as defined in the appended claims. Therefore, mere modifications to the present invention fall within the scope of the present invention.