Source: http://www.google.co.uk/patents/US8938465
Timestamp: 2017-12-17 10:11:31
Document Index: 463079665

Matched Legal Cases: ['Application No. 200880016311', 'Application No. 200880016311', 'Application No. 2008100826213', 'Application No. 200880016311', 'Application No. 2007101962371', 'Application No. 200880016311', 'Application No. 200880016311', 'Application No. 200880009063', 'Application No. 2010', 'Application No. 2010', 'Application No. 2009', 'Application No. 2009', 'Application No. 2009554447', 'Application No. 10', 'Application No. 200810082621', 'Application No. 200810082621']

Patent US8938465 - Method and system for utilizing packaged content sources to identify and ... - Google Patents
A method and system for providing access to content on an electronic device is provided. One embodiment includes receiving contextual information and querying a packaged content source for content related to the contextual information. Available content relating to the contextual information from the...http://www.google.co.uk/patents/US8938465?utm_source=gb-gplus-sharePatent US8938465 - Method and system for utilizing packaged content sources to identify and provide information based on contextual information
Publication number US8938465 B2
Application number US 12/544,994
Also published as US20100070895
Publication number 12544994, 544994, US 8938465 B2, US 8938465B2, US-B2-8938465, US8938465 B2, US8938465B2
Inventors Alan Messer
Patent Citations (213), Non-Patent Citations (109), Referenced by (1), Classifications (15), Legal Events (1)
US 8938465 B2
A method and system for providing access to content on an electronic device is provided. One embodiment includes receiving contextual information and querying a packaged content source for content related to the contextual information. Available content relating to the contextual information from the packaged content source is then indicated for user access.
1. A computer-implemented method for providing access to content, comprising:
receiving contextual information that includes information related to accessed content;
obtaining metadata information related to the accessed content;
determining a current application state of an application through which the accessed content is rendered;
in response to a request for additional content related to the accessed content, determining one or more suggested topics of interest based on the contextual information, the metadata information and the current application state;
querying at least one widget in a widget platform having multiple widgets for content related to the one or more suggested topics of interest by passing one or more keywords associated with the one or more suggested topics of interest to the at least one widget, wherein each widget is a portable, interactive package of graphics and script code that may be overlaid on a display to provide information;
indicating content related to the one or more suggested topics of interest available from at least one widget in the widget platform;
automatically invoking each widget in the widget platform that indicates available content related to the one or more suggested topics of interest; and
displaying content related to the one or more suggested topics of interest on a display of an electronic device;
wherein each widget in the widget platform is associated with a corresponding description identifying a type of information of interest the widget is configured to provide, such that the widget is invoked only when the type of information of interest corresponds to the one or more suggested topics of interest;
wherein the contextual information further includes one or more of: information of user interest, user context, device context, content context; and
wherein the contextual information is received from a contextual recommendation system that seeks to provide user access to additional content related to the contextual information.
the accessed content includes previously accessed content, wherein the previously accessed content represents content accessed by the device in the past;
indicating content relating to the one or more suggested topics of interest further includes:
displaying information about each widget that indicates available content related to the one or more suggested topics of interest on the display;
receiving user selection of a displayed widget source;
automatically invoking the selected widget to request content related to the one or more suggested topics of interest from one or more content sources by passing the one or more suggested topics of interest to the selected widget; and
displaying content related to the one or more suggested topics of interest on the display.
managing a search for content related to the one or more suggested topics of interest via the widget platform;
automatically querying multiple widgets for content related to the one or more suggested topics of interest;
displaying information about each widget that indicates available content related to the one or more suggested topics of interest on a display of the electronic device;
receiving user selection of a displayed widget;
automatically invoking the user selected widget to request content related to the one or more suggested topics of interest; and
the selected widget automatically displaying content related to the one or more suggested topics of interest on the display;
wherein each widget in the widget platform is used to identify and provide information based on a suggested topic of interest without directly using a search engine or database to find content.
4. The method of claim 3 wherein querying a widget further comprises:
invoking the widget using an application programming interface and providing a suggested topic of interest to the invoked widget for determining related content.
5. The method of claim 4 wherein each invoked widget provides content source processing implemented in a widget platform, by accessing content sources in a network to fetch content related to the one or more suggested topics of interest.
6. A search facilitator system for providing access to content on an electronic device, comprising:
a display for display of information;
a contextual recommender system for:
obtaining metadata information related to accessed content;
determining a current application state of an application through which the accessed content is rendered; and
determining, based on the metadata information, the current application state and contextual information that includes information related to the accessed content, one or more suggested topics of interest in response to a request for additional content related to the accessed content;
a search facilitator for:
receiving the one or more suggested topics of interest; and
querying at least one dynamic packaged content source of a packaged content source platform having multiple dynamic packaged content sources for content related to the one or more suggested topics of interest by passing one or more keywords associated with the one or more suggested topics of interest to the at least one dynamic packaged content source; and
displaying information about each dynamic packaged content source indicating available content related to the one or more suggested topics of interest; and
invoking a dynamic packaged content source indicating available content related to the one or more suggested topics of interest, wherein the invoked dynamic packaged content source is rendered on the display with available content related to the one or more suggested topics of interest:
wherein each dynamic packaged content source of the packaged content source platform is associated with a corresponding description identifying a type of information of interest the dynamic packaged content source is configured to provide, such that the dynamic packaged content source is invoked only when the type of information of interest corresponds to the one or more suggested topics of interest;
wherein the contextual information is received from the contextual recommender system that seeks to provide user access to additional content related to the contextual information.
the user interface is further configured for receiving user selection of a dynamic packaged content source indicating available content related to the one or more suggested topics of interest.
the search facilitator is configured to find content related to the one or more suggested topics of interest without directly using a search engine or database to find content.
9. The system of claim 6, wherein the search facilitator comprises a search manager for querying at least one dynamic packaged content source of a packaged content source platform having multiple dynamic packaged content sources for content related to the one or more suggested topics of interest.
10. The system of claim 6, wherein the search facilitator comprises an information display manager for selectively displaying information about each dynamic packaged content source indicating available content related to the one or more suggested topics of interest on the user interface.
11. The system of claim 6, wherein each dynamic packaged content source is a widget comprising a portable, interactive package of graphics and script code that may be overlaid on the display to provide information.
12. A computer program product for providing access to content on an electronic device, said computer program product comprising:
a non-transitory computer usable medium having a computer readable program code embodied therewith, wherein the computer readable program code when executed on the computer causes the computer to:
receive contextual information that includes information related to accessed content;
obtain metadata information related to the accessed content;
determine a current application state of an application through which the accessed content is rendered;
in response to a request for additional content related to the accessed content, determine one or more suggested topics of interest based on the contextual information, the metadata information and the current application state;
query at least one widget within a widget platform having multiple widgets for content related to the one or more suggested topics of interest by passing one or more keywords associated with the one or more suggested topics of interest to the at least one widget, wherein each widget comprises a package of graphics and script code that may be overlaid on a display to provide information;
indicate content related to the one or more suggested topics of interest available from said at least one widget;
invoke each widget that indicates available content related to the one or more suggested topics of interest; and
display content related to the one or more suggested topics of interest on the display of an electronic device;
13. The computer program product of claim 12 further comprising computer readable program code for:
displaying content related to the one or more suggested topics of interest on the display;
wherein the accessed content includes previously accessed content, and wherein the previously accessed content represents content accessed by the device in the past.
14. The computer program product of claim 12, the computer program product further comprising computer readable program code for:
15. The computer program product of claim 14 wherein the computer program product further comprises computer readable program code for:
querying a widget by invoking the widget using an application programming interface and providing a suggested topic of interest to the invoked widget for determining related content.
16. The computer program product of claim 15 wherein each invoked widget provides content source processing implemented in a widget platform, by accessing content sources in a network to fetch content related to the one or more suggested topics of interest.
17. The computer program product of claim 16 wherein the computer program product further comprises computer readable program code for:
a contextual recommendation module that seeks to provide the user access to content related to the one or more suggested topics of interest; and
receiving the one or more suggested topics of interest from the contextual recommendation module.
18. An electronic device for providing access to content, comprising:
receiving one or more suggested topics of interest determined based on metadata information related to accessed content, a current application state of an application through which the accessed content is rendered, and contextual information that includes information related to the accessed content, wherein the one or more suggested topics of interest are determined in response to a request for additional content related to the accessed content; and
querying at least one dynamic packaged content source of a packaged content source platform having multiple dynamic packaged content sources for content related to the one or more suggested topics of interest by passing one or more keywords associated with the one or more suggested topics of interest to the at least one dynamic packaged content source; and a user interface for:
19. The electronic device of claim 18 wherein:
the accessed content includes previously accessed content, wherein the previously accessed content represents content accessed by the device in the past; and
21. The electronic device of claim 18, wherein the search facilitator comprises a search manager for querying at least one dynamic packaged content source of a dynamic packaged content source platform having multiple dynamic packaged content sources for content related to the one or more suggested topics of interest.
22. The electronic device of claim 18, wherein the search facilitator comprises an information display manager for selectively displaying information about each dynamic packaged content source indicating available content related to the one or more suggested topics of interest on the user interface.
23. The electronic device of claim 18, wherein each dynamic packaged content source is a widget comprising a portable, interactive package of graphics and script code that may be overlaid on the display to provide information.
This application claims priority from U.S. Provisional Patent Application Ser. No. 61/095,922, filed on Sep. 10, 2008, incorporated herein by reference.
The present invention relates to providing access to information based on contextual information.
Software platform technologies such as widgets and downloadable applications/applets provide packaging a service or content source for consumer electronics devices. A widget comprises a package of graphics and script code that may be overlaid on an electronic device display screen to provide information to the user. For example, a weather widget may present content overlaid on the main data such that the graphic for the current conditions and temperature are made available. Widgets have a simple lifecycle in that they are downloaded, displayed, minimized and stopped. The interaction of the widget with the underlying software platform is limited because the platform only enables the widget to fetch data from the network and display on the screen for user viewing.
Downloadable applications and applets, particularly such as those in Java, are similar to widgets, but provide more extensive Application Programming Interface (API) for interaction. Java applications are capable of providing complex animations as well as complex network protocols. However, as with widgets, Java applications have limited ability to interact with the underlying platform or other software components. In other applications, a search engine is used to obtain content for a particular topic (set of keywords) based on internet infrastructure.
A method and system utilizing packaged content sources to identify and provide information of potential interest to a user based on contextual information is provided. One embodiment comprises a computer-implemented method for providing access to content, including receiving contextual information, and querying a packaged content source for content related to the contextual information. The method further includes indicating content relating to the contextual information available from the packaged content source.
FIG. 1 shows a functional block diagram of a system utilizing packaged content sources to identify and provide information based on contextual information, according to an embodiment of the invention.
FIG. 2 shows a functional block diagram of a system utilizing packaged content sources (e.g., widgets) to identify and provide information of potential interest to a user based on contextual information, according to an embodiment of the invention.
FIG. 3 shows a process utilizing packaged content sources to identify and provide information based on contextual information, according to an embodiment of the invention.
FIG. 4 shows a functional block diagram of a network implementing a process utilizing packaged content sources to identify and provide information based on contextual information, according to an embodiment of the invention.
FIG. 5 shows a functional block diagram of a computing system suitable for implementing an embodiment of the invention.
The invention provides a method and system for utilizing packaged content sources to identify and provide information based on contextual information. One embodiment involves a process for interacting with, and relating, content sources and representations with contextual information.
For example, packaged content sources, such as widgets, are utilized to find content sources for recommendation based on contextual information. As such, a search facilitator process according to the invention enables a contextual recommendation system (e.g., See‘N’Search) to interact with sources of information to be recommended by the recommendation system. The recommendation system is enabled to interact with packaged content sources.
The search facilitator process allows querying a dynamic packaged content source for available content. The search facilitator process further allows initiating a request to a packaged content source for information (e.g., content) relevant to contextual information, and displaying such information.
In one embodiment, a packaged content source is downloadable code that is executed to provide access to content data. A packaged content source comprises executable program code including a function to obtain information (such as over a network), and includes a function to source content using internal functionality. The packaged content source is executed locally on the processor of an electronic device it is downloaded to. The packaged content source includes interfaces, and when executed the packaged content source operates to obtain content information. The electronic device (e.g., a computer or a consumer electronics device) is provided a packaged content source from a remote location. The electronic device also receives contextual information. The electronic device then executes the packaged content source locally (i.e., local to the contextual information), wherein the packaged content source makes requests to obtain information based on the contextual information.
One embodiment provides a system implementing a search facilitator process for using content sources to source information such that a software module utilizing the facilitator process does not require information about the packaged content sources themselves. Such a software module may be a contextual recommender which may initiate a request to the search facilitator process based on contextual information, such as topics (e.g., set of keywords), that the contextual recommender may wish to suggest to the user. The search facilitator process utilizes packaged content sources that provide content source processing implemented in a packaged content source platform, such as in widget platform application logic. The packaged content sources may also include applets such as Java Applets. The user is provided with information relevant to the contextual information without a need for the contextual recommender to have information about the packaged content sources themselves. An implementation of the invention is described below in conjunction with widgets running on widget platforms.
Widget platforms provide an approach to making information available to users as a package, similar to HTML and a browser for displaying information content on a display screen of an electronic device. Several widget platforms exist, such as Konfabulator (now Yahoo! Widgets), Vista Sidebar, Google Widgets, Nokia Widgets, etc. Rather than assuming an opaque background and full screen display as in a browser, widget platforms take up a small portion of the display, allowing the user to “see through/around” the content displayed.
In widget platforms, the display is not rendered declaratively (e.g., using HTML), but instead, using a scripting language on a graphics/networking application programming interface (API). As such, widgets (running on widget platforms) are more suitable for displaying dynamic information because the script code in the widgets can make multiple requests to obtain information (e.g., over a period of time). Widgets are often based on a scripting language and are the web equivalent of Java Applets for Java.
FIG. 1 shows a functional block diagram of an example system 10 implementing a search facilitator process for interacting with, and relating, content sources/representations with contextual information, according to an embodiment of the invention. The process utilizes packaged content sources (e.g., widgets) to identify and provide information of potential interest to a user based on contextual information. The system 10 includes a search facilitator 103, a packaged content source platform (e.g., widget platform) 106, N package content sources 105 (e.g., widgets) running on the packaged content source platform 106, and a client device 104 providing a user interface (UI) 108. The client device 104 may comprise a consumer electronics device (having a processor, memory, etc.) capable of displaying information and receiving user comments/input.
A packaged content source 105 may execute on e.g., a device 111 or the device 104, which may communicate with the packaged content source platform 106 that may execute on a device 112 (remote or local to client 104) in a network. The search facilitator 103 may execute on the device 104, wherein the client device 104 or another device 111 in a network including devices 104, 111 (an example of such a network is provided in relation to FIG. 4 further below). Although in FIG. 1, the devices 104 and 112 are shown as separate devices, this is not a requirement. The devices 104 and 112 may be the same singular device which includes functionality of both the devices 104 and 112.
An overall process utilizing packaged content sources (e.g., widgets) to identify and provide information of potential interest to a user based on contextual information, according to the invention is now described in relation to FIG. 1. One or more topics 102 (e.g., keywords, etc.) of interest to the user are determined and each topic is passed to the search facilitator 103 which may include a search manager 109 and an information display manager 110. The search manager 109 queries packaged content sources 105 for available content related to user-selected topic. Packaged content sources 105 send content to the system.
The information display manager 110 selectively displays information about the packaged content sources 105 that have such content available, on a UI 108 of the device 104. The user may select a displayed packaged content source 105 from the UI 108 wherein the search facilitator 103 invokes the selected packaged content source 105 to execute on the selected packaged content source platform 106, passing along the user-selected topic to obtain related content. The obtained related content may be directly rendered on the UI 108 by the packaged content source platform 106.
A more detailed process utilizing packaged content sources (e.g., widgets) to identify and provide information of potential interest to a user based on contextual information, according to the invention is now described. FIG. 2 shows a functional block diagram of an example system 20 according to the invention, which includes components of the system 10, and further includes contextual information 100 and a contextual recommendation system 101. FIG. 3 shows a flowchart of a process 30 implemented by system 20 for utilizing packaged content sources (e.g., widgets) to identify and provide information of potential interest to a user based on contextual information, according to an embodiment of the invention.
Initially, in block 201 the packaged content source software platform 106 has either already downloaded each packaged content source (PCS) 105 or does so at start up. In block 202, the contextual recommender system 101 uses contextual information 100 to determine current topics. In one example, the contextual recommendation system 101 uses contextual information 100 to determine one or more topics 102 (e.g., keywords, etc.) that is of interest to the user. Contextual information 100 may include user context, device context, and/or content context. User context may include, for example, user actions, history, profile. Device context may include, for example, current content accessed by the device or in the network, metadata such as closed-captions, Electronic Programming Guide (EPG). Content context provides content more meaning than simply words.
In block 203, once one or more topics have been determined, each topic is passed to the search facilitator 103 (e.g., software component which may include a searching function and an information display manager function).
In block 204, the search facilitator 103 may first pass each topic to each packaged content source 105 as a request, to determine if each packaged content source 105 has any content for the topic. Each request functions as a callback into the respective packaged content source and causes the program logic of the packaged content source to perform its programmed steps necessary to determine if such requested content is available. In addition a packaged content source may inform the system on its own volition.
In block 205, information (e.g., identification, hyperlink) about each packaged content source 105 that responds with “TRUE” for potential content is displayed to the user on the user interface (UI) 108 of the client device 104. Optionally, information about all the packaged content sources 105 is listed to the user for them to select amongst on the UI 108.
In block 206, the UI 108 visually renders information and availability from the packaged content sources 105 to the user (e.g., Source 1, . . . , Source n). When multiple topics are available, the UI 108 may optionally allow the user to switch among such topics to browse the topics and also view the content available from the corresponding packaged content sources.
In block 207, the UI 108 invokes the selected packaged content source via the information display manager to run (execute) on the packaged content source platform 106. The selected topic is passed to the invoked packaged content source.
In block 208, the packaged content source platform 106 performs any necessary functions or backend content sources 107 (FIG. 2) such as the Internet or search engines, in order to display content related to the selected topic. The search facilitator may selectively display information from packaged content sources 105 to the user on a user interface 108 of a device 104.
In block 209, packaged content source invocation causes the UI 108 of the device 104 to change to UI 108A (FIG. 2), wherein the selected packaged content source (i.e., widget) display is rendered on the UI 108A to the user with obtained content related to the selected topic. Optionally, the invoked packaged content source may ignore the passed topics and display generic information.
The invention provides a mechanism comprising the search facilitator 103 which allows a software component, such as the contextual recommendation system 101 to interact with packaged content sources 105 via the search facilitator 103, to determine if there is related information that the contextual recommendation system 101 can use (e.g., recommend to the user). This enables the contextual recommendation system 101 to avoid using a search engine or database directly to find content related to topic. Instead, the search facilitator 103 enables the contextual recommendation system 101 to use packaged content sources 105 for which a method of fetching results is encapsulated as to be opaque to the rest of the system.
Given contextual information, the search facilitator 103 enables interaction with packaged content sources 105 such as (e.g., widgets, packaged downloadable applications) to determine related content for recommendation. Widgets comprise package of graphics and script code that may be overlaid on the screen to provide information to the user.
The system 20 enables querying (requesting) dynamic packaged content sources 105 from another software component such as the contextual recommender system 101, to determine whether content related to a topic is available from such sources. Optionally a packaged content source may inform the platform 106 of its interests. In the query step it is determined if related content is available, then in the invocation step the packaged content source renders the related content accordingly (e.g., the related content itself may be directly rendered on the UI 108A by the packaged content source platform 106).
The system 20 enables a software component to initiate a request to package content sources to display content. The system 20 allows querying packaged content sources, passing a particular (selected or current) topic to the packaged content source, so that they may be related to the initiating request.
The contextual recommendation system determines from a content source a set of topics (e.g., multiple keywords, determined from closed captions of a video program the user is watching of a client device such as a digital TV) that the contextual recommendation system wishes to recommend to the user. For each possible packaged content source, the search facilitator passes each topic to each packaged content source API to determine if any content is available for that source. Information about each packaged content source that returned “True” (or met a threshold via a ranking criteria) is then displayed to the user.
The user then selects one of the topic/source combinations. At which time the search facilitator initiates a call to a selected packaged content source to initiate rendering the widget. Optionally the initiation may pass the current selected topic (or related topics) to the packaged content source so that the packaged content source can display related content on that particular topic. The packaged content source displays its content according to its internal method and optionally uses the passed topic to direct the data that is displayed to the user.
In another embodiment, a software component such as a contextual recommender desiring to use a packaged content source, determines a topic (e.g., multiple keywords, determined from closed captions of a video program the user is watching of a client device such as a TV) and utilizes the search facilitator which queries one or more packaged content sources to check for related information for the user.
Optionally, for each possible packaged content source (e.g., widget, applet), the search facilitator may pass each topic in the form of a set of keywords to each packaged content source API to determine if any content is available from that source. The API called may return a True/False value or may return a quality value (e.g., x out of 10) to the calling component. For each packaged content source that returned ‘True’ (or met a threshold via a ranking criteria), the obtained related content is then displayed to the user. For example, “YouTube videos on ‘George Bush’”.
If the search facilitator did not execute that optional step of passing each topic in the form of a set of keywords to each packaged content source, then for each packaged content source, the search facilitator displays the content source name and the topic to the user. The user then selects one of the topic/source combinations the user wishes to view the content for. At which time the search facilitator initiates a call to the packaged content source to initiate rendering the content source. The call may pass the current selected topic (or related topics) to the packaged content source so that it can display content to that particular topic. The packaged content source displays its content according to its internal method (program logic) and optionally uses the passed topic to direct the data that is displayed to the user.
FIG. 4 shows a functional architecture of an example network 40, including a local network and an external (remote) network. The local network may comprise a local area network of electronic devices, embodying aspects of the present invention. The local network comprises an electronic device 111 which includes processing capability, a personal computer (PC) 121, consumer electronics (CE) devices 104 which may include content, and an interface 140 that connects the local network to the remote network (e.g., another local network, the Internet 107) via a communication line.
The remote network can include devices 112 and 151. The local network may implement the Universal Plug and Play (UPnP) protocol or other network communication protocols (e.g., Jini, HAVi, IEEE 1394, etc.). The local network can be a wireless network, a wired network, or a combination thereof. Examples of CE devices include digital televisions (DTVs, PDAs, media players, etc.). The local network further includes a search facilitator 103 implemented in a CE device 104 having a UI 108 and further implementing a contextual recommendation system 101. The local network may further include a device 112 implementing packaged content source platform 106 for package content sources 105. The remote network may further include a device 112 implementing packaged content source platform 106 for package content sources 105.
The search facilitator 103 initiates the package content sources 105 programmatically for the contextual recommendation system 101. The search facilitator 103 may request a package content sources 105 to indicate if it has content available for a particular context (e.g., topic such as a set of keywords). The search facilitator 103 may parameterize (i.e., provide contextual information) a request to a package content source 105 in the form of e.g., a topic such as a set of keywords, so that the package content source 105 may provide information related to the context.
In this way, a contextual recommendation system may access packaged content sources to render information related to contextual information on a display screen without relying on a web browser or video player application.
An example of the contextual recommendation system is described below. The contextual recommendation system provides the following functions:
1. Mapping the functionalities that support an information search to a small number of keys (e.g., mapping such functionalities to a few keys of a TV remote control, as an example for receiving user input when using a digital TV (DTV) for information access).
2. Enabling the user to express interest in obtaining additional information related to information currently accessed by the user (e.g., providing an “info.” button on the remote control for the user to press, and mapping this action into a “more info” request, etc.).
3. Enabling the user to indicate the specific type of additional information the user is looking for, after the user has expressed interest in accessing additional information. An example involves displaying a set of keywords related to the data that the user has expressed interest in (e.g., a TV program or media content the user is accessing). Then, providing a combination of keys (e.g., up/down/right/left arrow keys) on a remote control for the user to select one of the keywords as one or more topics.
4. Enabling the user to refine or edit a suggested topic, such as by displaying a set of additional topic suggestions that contain, or are related to, the selected keyword and providing a combination of the arrow keys (up/down/right/left arrows) on the remote control for the user to select one of the topic suggestions. The graphical user interface (GUI) allows the user to refine the search topics as many times as the user desires by just repeating the process described above. Further, the topic suggestions are displayed in an editable text box that allows the user to delete existing characters or enter new characters to modify the topic as desired. This can be performed using, e.g., a wireless keyboard or a remote control that has an inbuilt keypad. The topics include information that provide the source of topics.
In one example, a topic identification function performs the above steps to identify potential data of interest to the user (e.g., source of topics) based on the user's current application state. Current application state refers to the state of the application that the user is using at the time the user desires to access relevant content. For example, if the user is watching a television program on DTV, the channel the DTV is tuned to and the program being broadcast, constitute the application state. The topic identification function identifies the content used/rendered by the application. Then, the topic identification function obtains metadata information and/or other associated data for the content being accessed, and identifies potential topics that might represent the data of interest to the user.
When a user accesses content that has structured meta-data available, the topic identification function directly uses field/value pairs from the metadata as potential topics. For example, if a user is listening to a music album by the artist “Sting” and expresses interest to access related content, the topic identification function obtains the following fields from the album's metadata (content=“MusicAlbum” and artist=“Sting”) and using these, the topic identification function infers that the user might be interested to access more albums by the same artist and suggests (MusicAlbum, artist, “Sting”) as one of the topics to the user.
When a user accesses content such as broadcast TV programs and DVDs, the topic identification function uses the caption data (closed captions), that is embedded in the content stream, to identify topics. This embedded caption data contains useful information in the form of keywords. When a user watches a TV program and expresses interest to access related content, the topic identification function analyzes the TV program's caption text to identify significant keywords and suggests them to the user as possible search topics.
An example of identifying keywords and suggesting them as possible topics by the topic identification function involves utilizing natural language processing (NLP) to analyze closed captions and identify keywords from the captions. The closed captions (CC) of a TV program are embedded in the TV signal by the content provider before it is broadcast. They are primarily for the benefit of the hearing impaired.
In another embodiment, associated with a packaged content source such as a widget is type of information the widget is interested in (implemented as a function call or configuration), and a list of keywords the widget is interested in. Each widget has descriptions attached to it that tells the system what kind of information the widget is interested in (e.g., people, places, dates). As such, a particular widget is invoked only when information of the type the widget is interested in is involved. The information may comprise keywords in contextual information. A packaged content source is configured for informing the system of the type of information of interest to the packaged content source. A search manager configured for querying a packaged content source for content related to the contextual information, based on information of interest to the packaged content source.
FIG. 5 shows a block diagram of an example system 50 in which an embodiment of the invention may be implemented. The system 50 includes one or more client devices 301 such as consumer electronics devices, connected to one or more server computing systems 330. A server 330 includes a bus 302 or other communication mechanism for communicating information, and a processor (CPU) 304 coupled with the bus 302 for processing information. The server 330 also includes a main memory 306, such as a random access memory (RAM) or other dynamic storage device, coupled to the bus 302 for storing information and instructions to be executed by the processor 304. The main memory 306 also may be used for storing temporary variables or other intermediate information during execution or instructions to be executed by the processor 304. The server computer system 330 further includes a read only memory (ROM) 308 or other static storage device coupled to the bus 302 for storing static information and instructions for the processor 304. A storage device 310, such as a magnetic disk or optical disk, is provided and coupled to the bus 302 for storing information and instructions. The bus 302 may contain, for example, thirty-two address lines for addressing video memory or main memory 306. The bus 302 can also include, for example, a 32-bit data bus for transferring data between and among the components, such as the CPU 304, the main memory 306, video memory and the storage 310. Alternatively, multiplex data/address lines may be used instead of separate data and address lines.
The server 330 may be coupled via the bus 302 to a display 312 for displaying information to a computer user. An input device 314, including alphanumeric and other keys, is coupled to the bus 302 for communicating information and command selections to the processor 304. Another type or user input device comprises cursor control 316, such as a mouse, a trackball, or cursor direction keys for communicating direction information and command selections to the processor 304 and for controlling cursor movement on the display 312.
According to one embodiment of the invention, the functions of the invention are performed by the processor 304 executing one or more sequences of one or more instructions contained in the main memory 306. Such instructions may be read into the main memory 306 from another computer-readable medium, such as the storage device 310. Execution of the sequences of instructions contained in the main memory 306 causes the processor 304 to perform the process steps described herein. One or more processors in a multi-processing arrangement may also be employed to execute the sequences of instructions contained in the main memory 306. In alternative embodiments, hard-wired circuitry may be used in place of or in combination with software instructions to implement the invention. Thus, embodiments of the invention are not limited to any specific combination of hardware circuitry and software.
The terms “computer program medium,” “computer usable medium,” “computer readable medium”, and “computer program product,” are used to generally refer to media such as main memory, secondary memory, removable storage drive, a hard disk installed in hard disk drive, and signals. These computer program products are means for providing software to the computer system. The computer readable medium allows the computer system to read data, instructions, messages or message packets, and other computer readable information from the computer readable medium. The computer readable medium, for example, may include non-volatile memory, such as a floppy disk, ROM, flash memory, disk drive memory, a CD-ROM, and other permanent storage. It is useful, for example, for transporting information, such as data and computer instructions, between computer systems. Furthermore, the computer readable medium may comprise computer readable information in a transitory state medium such as a network link and/or a network interface, including a wired network or a wireless network that allow a computer to read such computer readable information. Computer programs (also called computer control logic) are stored in main memory and/or secondary memory. Computer programs may also be received via a communications interface. Such computer programs, when executed, enable the computer system to perform the features of the present invention as discussed herein. In particular, the computer programs, when executed, enable the processor multi-core processor to perform the features of the computer system. Accordingly, such computer programs represent controllers of the computer system.
Generally, the term “computer-readable medium” as used herein refers to any medium that participated in providing instructions to the processor 304 for execution. Such a medium may take many forms, including but not limited to, non-volatile media, volatile media, and transmission media. Non-volatile media includes, for example, optical or magnetic disks, such as the storage device 310. Volatile media includes dynamic memory, such as the main memory 306. Transmission media includes coaxial cables, copper wire and fiber optics, including the wires that comprise the bus 302. Transmission media can also take the form of acoustic or light waves, such as those generated during radio wave and infrared data communications.
Various forms of computer readable media may be involved in carrying one or more sequences of one or more instructions to the processor 304 for execution. For example, the instructions may initially be carried on a magnetic disk of a remote computer. The remote computer can load the instructions into its dynamic memory and send the instructions over a telephone line using a modem. A modem local to the server 330 can receive the data on the telephone line and use an infrared transmitter to convert the data to an infrared signal. An infrared detector coupled to the bus 302 can receive the data carried in the infrared signal and place the data on the bus 302. The bus 302 carries the data to the main memory 306, from which the processor 304 retrieves and executes the instructions. The instructions received from the main memory 306 may optionally be stored on the storage device 310 either before or after execution by the processor 304.
In another embodiment of the server 330, interface 318 is connected to a network 322 via a communication link 320. For example, the communication interface 318 may be an integrated services digital network (ISDN) card or a modem to provide a data communication connection to a corresponding type of telephone line, which can comprise part of the network link 320. As another example, the communication interface 318 may be a local area network (LAN) card to provide a data communication connection to a compatible LAN. Wireless links may also be implemented. In any such implementation, the communication interface 318 sends and receives electrical electromagnetic or optical signals that carry digital data streams representing various types of information.
The server 330 can send/receive messages and data, including e-mail, program code, through the network, the network link 320 and the communication interface 318. Further, the communication interface 318 can comprise a USB/Tuner and the network link 320 may be an antenna or cable for connecting the server 330 to a cable provider, satellite provider or other terrestrial transmission system for receiving messages, data and program code from another source.
The example versions of the invention described herein may be implemented as logical operations in a distributed processing system such as the system 50 including the servers 330. The logical operations of the present invention may be implemented as a sequence of steps executing in the server 330, and as interconnected machine modules within the system 50. The implementation is a matter of choice and can depend on performance of the system 50 implementing the invention. As such, the logical operations constituting said example versions of the invention are referred to for e.g., as operations, steps or modules.
Similar to a server 330 described above, a client device 301 can include a processor, memory, storage device, display, input device and communication interface (e.g., e-mail interface) for connecting the client device to the Internet 328, the ISP 326, or LAN 322, for communication with the servers 330.
The system 50 can further include computers (e.g., personal computers, computing nodes) 305 operating in the same manner as client devices 301, wherein a user can utilize one or more computers 305 to manage data in the server 330.
US5995959 23 Jan 1998 30 Nov 1999 The Board Of Regents Of The University Of Washington Method and system for network information access
US6151603 24 Aug 1999 21 Nov 2000 Wolfe; Mark A. Document retrieval system employing a preloading procedure
US6412073 8 Dec 1998 25 Jun 2002 Yodiee.Com, Inc Method and apparatus for providing and maintaining a user-interactive portal system accessible via internet or other switched-packet-network
US6480844 25 Mar 1999 12 Nov 2002 At&T Corp. Method for inferring behavioral characteristics based on a large volume of data
US7194460 31 Mar 2003 20 Mar 2007 Kabushiki Kaisha Toshiba Search device, search system, and search method
US7203940 29 Apr 2002 10 Apr 2007 Hewlett-Packard Development Company, Lp. Automated installation of an application
US7363294 19 Dec 2003 22 Apr 2008 Fuji Xerox Co., Ltd. Indexing for contextual revisitation and digest generation
US7389224 23 Feb 2000 17 Jun 2008 Canon Kabushiki Kaisha Natural language search method and apparatus, including linguistically-matching context data
US7389307 9 Aug 2001 17 Jun 2008 Lycos, Inc. Returning databases as search results
US7433935 29 Apr 2005 7 Oct 2008 Hewlett-Packard Development Company, L.P. Self-adapting plug-in service
US7552114 7 Mar 2007 23 Jun 2009 International Business Machines Corporation System, and method for interactive browsing
US7593921 27 Aug 2003 22 Sep 2009 Sony Deutschland Gmbh Methods to create a user profile and to specify a suggestion for a next selection of a user
US7603349 10 Jan 2005 13 Oct 2009 Yahoo! Inc. User interfaces for search systems using in-line contextual queries
US7657518 31 Jan 2007 2 Feb 2010 Northwestern University Chaining context-sensitive search results
US7685192 30 Jun 2006 23 Mar 2010 Amazon Technologies, Inc. Method and system for displaying interest space user communities
US20010003214 30 Nov 2000 7 Jun 2001 Vijnan Shastri Method and apparatus for utilizing closed captioned (CC) text keywords or phrases for the purpose of automated searching of network-based resources for interactive links to universal resource locators (URL's)
US20010023433 7 Mar 2001 20 Sep 2001 Kabushiki Kaisha Toshiba Information delivery system, information providing apparatus, information storage apparatus and information providing method
US20020022491 16 Aug 2001 21 Feb 2002 Mccann Stephen LAN services delivery system
US20020026436 31 Aug 2001 28 Feb 2002 Rafael Joory Supplanting application setup data and preserving the application setup data that has been supplanted
US20020032693 18 Jan 2001 14 Mar 2002 Jen-Diann Chiou Method and system of establishing electronic documents for storing, retrieving, categorizing and quickly linking via a network
US20020087535 26 Oct 2001 4 Jul 2002 Aaron Kotcheff Apparatus and a method for facilitating searching
US20020162121 28 Dec 2001 31 Oct 2002 Digeo, Inc. System and method to subscribe to channel URL addresses and to provide non-programming-related URL addresses in an interactive video casting system
US20030033273 13 Aug 2001 13 Feb 2003 Wyse James Edmund System and method for retrieving location-qualified site data
US20030088553 23 Nov 2002 8 May 2003 Emergency 24, Inc. Method for providing relevant search results based on an initial online search query
US20030131013 27 Sep 2002 10 Jul 2003 Cameron Pope Automated system and methods for determining relationships between information resources
US20030184582 6 Mar 2003 2 Oct 2003 Cohen Thomas Andrew Browser plug-ins
US20030221198 21 May 2002 27 Nov 2003 Sloo David Hendler Interest messaging entertainment system
US20030231868 27 Nov 2002 18 Dec 2003 Microsoft Corporation System and method for identifying and segmenting repeating media objects embedded in a stream
US20040073944 15 Oct 2002 15 Apr 2004 General Instrument Corporation Server-based software architecture for digital television terminal
US20040107821 3 Oct 2003 10 Jun 2004 Polyphonic Human Media Interface, S.L. Method and system for music recommendation
US20040244038 18 Jul 2003 2 Dec 2004 Shingo Utsuki Video search assisting method, video search assisting device, and broadcast receiving apparatus
US20040249790 31 Mar 2003 9 Dec 2004 Toshiba Tec Kabushiki Kaisha Search device, search system, and search method
US20050004910 30 Jun 2004 6 Jan 2005 Trepess David William Information retrieval
US20050137996 19 Dec 2003 23 Jun 2005 Fuji Xerox Co., Ltd. Indexing for contextual revisitation and digest generation
US20050144158 18 Nov 2004 30 Jun 2005 Capper Liesl J. Computer network search engine
US20050154711 9 Jan 2004 14 Jul 2005 Mcconnell Christopher C. System and method for context sensitive searching
US20050160460 26 Feb 2003 21 Jul 2005 Nobuyuki Fujiwara Information processing apparatus and method
US20050177555 11 Feb 2004 11 Aug 2005 Alpert Sherman R. System and method for providing information on a set of search returned documents
US20050246726 27 Apr 2005 3 Nov 2005 Fujitsu Limited Task computing
US20050278362 17 Feb 2005 15 Dec 2005 Maren Alianna J Knowledge discovery system
US20050289599 1 Jun 2005 29 Dec 2005 Pioneer Corporation Information processor, method thereof, program thereof, recording medium storing the program and information retrieving device
US20060026152 13 Jul 2004 2 Feb 2006 Microsoft Corporation Query-based snippet clustering for search result grouping
US20060028682 12 Oct 2005 9 Feb 2006 Haines Robert E Hardcopy output engine consumable supply management and method
US20060066573 12 Jan 2005 30 Mar 2006 Fujitsu Limited Device control system
US20060074883 5 Oct 2004 6 Apr 2006 Microsoft Corporation Systems, methods, and interfaces for providing personalized search and information access
US20060084430 14 Oct 2004 20 Apr 2006 Ng Eric M System and method for categorizing information into zones to determine delivery patterns
US20060095415 9 May 2005 4 May 2006 Juergen Sattler System and method for obtaining information from a data management system
US20060133391 19 May 2005 22 Jun 2006 Electronics And Telecommunications Research Institute Multimedia service apparatus and method for multimedia service providers outside home to UPnP devices inside home using home gateway and service gateway platform
US20060136670 27 Jan 2006 22 Jun 2006 Microsoft Corporation Method and system for an atomically updated, central cache memory
US20060156252 9 Aug 2005 13 Jul 2006 Samsung Electronics Co., Ltd. Contextual task recommendation system and method for determining user's context and suggesting tasks
US20060161542 18 Jan 2005 20 Jul 2006 Microsoft Corporation Systems and methods that enable search engines to present relevant snippets
US20060184515 1 Nov 2005 17 Aug 2006 America Online, Inc., A Delaware Corporation Category searching
US20060195362 31 Mar 2006 31 Aug 2006 Jacobi Jennifer A Recommendation system
US20060210157 2 Apr 2004 21 Sep 2006 Koninklijke Philips Electronics N.V. Method and apparatus for summarizing a music video using content anaylsis
US20060242283 21 Sep 2005 26 Oct 2006 Dell Products L.P. System and method for managing local storage resources to reduce I/O demand in a storage area network
US20070038601 10 Aug 2005 15 Feb 2007 Guha Ramanathan V Aggregating context data for programmable search engines
US20070043703 18 Aug 2005 22 Feb 2007 Partha Bhattacharya Method and system for inline top N query computation
US20070050346 25 Oct 2006 1 Mar 2007 Aol Llc Enabling a Search for Both Local and Remote Electronic Content
US20070073894 13 Sep 2006 29 Mar 2007 O Ya! Inc. Networked information indexing and search apparatus and method
US20070107019 7 Nov 2005 10 May 2007 Pasquale Romano Methods and apparatuses for an integrated media device
US20070130585 23 Nov 2006 7 Jun 2007 Perret Pierre A Virtual Store Management Method and System for Operating an Interactive Audio/Video Entertainment System According to Viewers Tastes and Preferences
US20070143266 28 Jun 2006 21 Jun 2007 Ebay Inc. Computer-implemented method and system for combining keywords into logical clusters that share similar behavior with respect to a considered dimension
US20070156447 29 Dec 2006 5 Jul 2007 Samsung Electronics Co., Ltd. Method and apparatus for obtaining external charged content in UPnP network
US20070179776 27 Jan 2006 2 Aug 2007 Xerox Corporation Linguistic user interface
US20070208755 28 Feb 2007 6 Sep 2007 Oracle International Corporation Suggested Content with Attribute Parameterization
US20070220037 20 Mar 2006 20 Sep 2007 Microsoft Corporation Expansion phrase database for abbreviated terms
US20070233287 30 Mar 2006 4 Oct 2007 Samsung Electronics Co., Ltd. Dynamic generation of tasks in resource constrained devices
US20070300078 28 Jun 2005 27 Dec 2007 Matsushita Electric Industrial Co., Ltd. Recording Medium, and Device and Method for Recording Information on Recording Medium
US20080040316 31 Mar 2004 14 Feb 2008 Lawrence Stephen R Systems and methods for analyzing boilerplate
US20080082744 1 Dec 2006 3 Apr 2008 Yutaka Nakagawa Storage system having data comparison function
US20080097982 18 Oct 2006 24 Apr 2008 Yahoo! Inc. System and method for classifying search queries
US20080133501 30 Nov 2006 5 Jun 2008 Microsoft Corporation Collaborative workspace context information filtering
US20080162731 29 Dec 2006 3 Jul 2008 Nokia Corporation Providing advertising content to at least one communicating terminal
US20080183596 31 Jan 2007 31 Jul 2008 Ebay Inc. Bid system for presentation of data items
US20080229240 * 15 Mar 2007 18 Sep 2008 Zachary Adam Garbow Finding Pages Based on Specifications of Locations of Keywords
US20080256460 * 28 Nov 2007 16 Oct 2008 Bickmore John F Computer-based electronic information organizer
US20090055393 31 Oct 2008 26 Feb 2009 Samsung Electronics Co., Ltd. Method and system for facilitating information searching on electronic devices based on metadata information
US20090064017 * 2 Sep 2008 5 Mar 2009 Jacked, Inc. Tuning/customization
US20090070184 8 Aug 2006 12 Mar 2009 Concert Technology Corporation Embedded media recommendations
US20090077052 21 Jun 2006 19 Mar 2009 Concert Technology Corporation Historical media recommendation service
US20090077065 13 Sep 2007 19 Mar 2009 Samsung Electronics Co., Ltd. Method and system for information searching based on user interest awareness
US20090112848 31 Oct 2007 30 Apr 2009 Samsung Electronics Co., Ltd. Method and system for suggesting search queries on electronic devices
US20090119717 4 Dec 2003 7 May 2009 Koninklijke Philips Electronics N.V. Method and system for utilizing video content to obtain text keywords or phrases for providing content related to links to network-based resources
US20090288014 * 17 Mar 2009 19 Nov 2009 Robb Fujioka Widget platform, system and method
US20100070895 20 Aug 2009 18 Mar 2010 Samsung Electronics Co., Ltd. Method and system for utilizing packaged content sources to identify and provide information based on contextual information
US20100191619 5 Apr 2010 29 Jul 2010 Dicker Russell A User interface and methods for recommending items to users
US20100281393 * 24 Feb 2010 4 Nov 2010 Robb Fujioka Widget Platform, System and Method
CN1393107A 11 Jul 2001 22 Jan 2003 皇家菲利浦电子有限公司 Transcript triggers for video enhancement
CN1585947A 22 Oct 2002 23 Feb 2005 皇家飞利浦电子股份有限公司 Method and system for personal information retrieval, update and presentation
CN1723458A 4 Dec 2003 18 Jan 2006 皇家飞利浦电子股份有限公司 Method and system for utilizing video content to obtain text keywords or phrases for providing content related links to network-based resources
CN1808430A 31 Oct 2005 26 Jul 2006 西安迪戈科技有限责任公司 Internet and computer information retrieval and mining with intelligent conceptual filtering, visualization and automation
CN1848742A 10 Jan 2006 18 Oct 2006 三星电子株式会社 Contextual task recommendation system and method for determining user's context and suggesting tasks
CN1906610A 30 Nov 2004 31 Jan 2007 皇家飞利浦电子股份有限公司 System and method for integrative analysis of intrinsic and extrinsic audio-visual data
JP2004505563A Title not available
JP2006228198A Title not available
JP2007012013A Title not available
KR20020005147A Title not available
KR20020006810A Title not available
KR20040052339A Title not available
KR20060027226A Title not available
KR20060092993A Title not available
WO2001037465A3 26 Oct 2000 10 Jan 2002 Koninkl Philips Electronics Nv Method and apparatus for audio/data/visual information selection
WO2001080077A1 * 18 Apr 2001 25 Oct 2001 Korea Telecom Method and system for retrieving information based on meaningful core word
WO2002043310A3 19 Oct 2001 24 Oct 2002 Wavexpress Inc System and method of providing relevant interactive content to a broadcast display
WO2003042866A3 22 Oct 2002 6 May 2004 Koninkl Philips Electronics Nv Method and system for personal information retrieval, update and presentation
WO2005055196A3 30 Nov 2004 23 Feb 2006 Nevenka Dimitrova System & method for integrative analysis of intrinsic and extrinsic audio-visual data
WO2005072157A3 18 Jan 2005 8 Feb 2007 Hillcrest Lab Inc Metadata brokering server and methods
WO2007004110A3 26 Jun 2006 22 Mar 2007 Koninkl Philips Electronics Nv System and method for the alignment of intrinsic and extrinsic audio-visual information
WO2008030875A2 * 5 Sep 2007 13 Mar 2008 Apple Inc. Portable multifunction device, method, and graphical user interface for configuring and displaying widgets
1 "Computing Meng Individual Project, ANSES-Automatic News Summarization and Extraction System, "http://mmis.doc.ic.ac.uk/pr-1.wong-2002/overview.html, downloaded Sep. 24, 2008, 4 pages.
2 "Computing Meng Individual Project, ANSES—Automatic News Summarization and Extraction System, "http://mmis.doc.ic.ac.uk/pr-1.wong-2002/overview.html, downloaded Sep. 24, 2008, 4 pages.
3 "Placement in the DMOZ.org directory-Pure Power", DMOZ/Google Directory, posted on Apr. 30, 2005, http://www.ahfx.net/weblog/13, pp. 1-3, United States.
4 "Placement in the DMOZ.org directory—Pure Power", DMOZ/Google Directory, posted on Apr. 30, 2005, http://www.ahfx.net/weblog/13, pp. 1-3, United States.
6 Apple Inc., Apple iTunes, http://www.apple.com/itunes/, Apr. 28, 2003, pp. 1-2, United States.
8 Babaguchi, N. et al., "Intermodal collaboration: A strategy for semantic content analysis for broadcasted sports analysis video", Sep. 2003, pp. 13-16, United States.
9 Brill, E., "A simple rule-based part of speech tagger", Mar. 1992, Proceedings of the Third Conference on Applied Natural Language Processing, Trento, Italy.
10 Chinese Office Action dated Apr. 17, 2012 from Chinese Application No. 200880016311.X-A machine English translation is included herewith.
11 Chinese Office Action dated Apr. 17, 2012 from Chinese Application No. 200880016311.X—A machine English translation is included herewith.
12 Chinese Office Action dated Aug. 14, 2009 issued in Chinese Patent Application No. 2008100826213.
13 Chinese Office Action dated Aug. 28, 2012 for Chinese Application No. 200880016311.X from China Patent Office, pp. 1-24, People's Republic of China (English-language translation included, pp. 1-15).
14 Chinese Office Action dated Feb. 1, 2011 from Chinese Application No. 2007101962371.
15 Chinese Office Action dated Mar. 7, 2013 for Chinese Application No. 200880016311.X from China Intellectual Property Office, pp. 1-25, People's Republic of China (English-language translation included, pp. 1-16).
16 Chinese Office Action dated Sep. 23, 2011 from Chinese Application No. 200880016311.X.
17 Chinese Office Action dated Sep. 8, 2011 from Chinese Application No. 200880009063.6.
18 Copernic Inc., Copernic Search Engine for your PC, http://www.copernic.com, downloaded Sep. 19, 2008, pp. 1, United States.
19 Copernic Inc., http://copernic.com/en/products/desktop-search/index.html, Sep. 18, 2008.
20 Final Office Action dated Jun. 17, 2010 from U.S. Appl. No. 11/981,019.
21 Final Office Action dated Mar. 16, 2011 from U.S. Appl. No. 11/981,019.
22 Final Office Action dated Nov. 10, 2011 from U.S. Appl. No. 11/803,826.
23 Final Office Action dated Nov. 23, 2010 from U.S. Appl. No. 12/056,184.
24 Final Office Action dated Sep. 1, 2011 from U.S. Appl. No. 12/263,089.
25 Final Office Action dated Sep. 2, 2010 from U.S. Appl. No. 11/969,778.
26 Final Office Action dated Sep. 21, 2011 from U.S. Appl. No. 11/633,880.
27 Final Office Action dated Sep. 27, 2011 from U.S. Appl. No. 11/969,778.
28 Google Inc., Google Desktop Search, http://desktop.google.com, downloaded Sep. 19, 2008, pp. 1, United States.
29 Google Inc., Google Search Engine, http://www.google.com, downloaded Sep. 19, 2008, pp. 1, United States.
30 Google Inc., webhp, http://www.google.com/webhp?complete-1&hl-en, downloaded Sep. 25, 2008, p. 1.
31 Henzinger, M. et al., "Query-free news search," May 2003, Proceedings on the 12th International Conference on World Wide Web, Budapest, Hungary, United States.
32 Japanese Office Action dated Apr. 10, 2012 from Japanese Application No. 2010-508303-A machine English translation is included herewith.
33 Japanese Office Action dated Apr. 10, 2012 from Japanese Application No. 2010-508303—A machine English translation is included herewith.
34 Japanese Office Action dated Mar. 21, 2012 from Japanese Application No. 2009-554447-A machine English translation is included herewith.
35 Japanese Office Action dated Mar. 21, 2012 from Japanese Application No. 2009-554447—A machine English translation is included herewith.
36 Japanese Office Action dated Nov. 20, 2012 for Japanese Application No. 2009554447 from Japan Patent Office, pp. 1-4, Tokyo, Japan (Machine generated English-language translation included, pp. 1-2).
37 Korean Office Action dated Apr. 29, 2014 for Korean Application No. 10-2008-7016274 from Korean Patent Office, pp. 1-13, Daejeon, Republic of Korea (Machine-generated English-language translation, pp. 7-13).
38 Livingston, K. at al., "Beyond broadcast: a demo," Jan. 2003, In Proceedings of the 8th International Conference on Intelligent user interfaces, ACM Press, New York, NY, pp, 325-325, United States.
39 Livingston, K. et al., "Beyond broadcast: a demo," Jan. 2003, In Proceedings of the 8th International Conference on Intelligent user Interfaces, ACM Press, New York, NY, pp. 260-262, United States.
40 Microsoft Corporation, Microsoft Windows Media Player 10, http://www.microsoft.com/windows/windowsmedia/mp10, downloaded Sep. 19, 2008, United States.
41 Microsoft Corporation, Microsoft Windows Media Player, http://www.microsoft.com/windows/windowsmedia/, Sep. 19, 2008, pp. 1, United States.
42 Microsoft Corporation, MSN TV, http://www.webtv.com/pc, downloaded Sep. 19, 2008, pp. 1, United States.
43 Miura, K. et al., "Automatic Generation of a Multimedia Encyclopedia from TV Programs by Using Closed Captions and Detecting Principal Viedo Objects," Proceedings of the Eigth IEEE International Sympsosium on Miltumedia (ISM ' 06), 2006, IEEE, 8 pages.
44 Miyamori, H. et al., "Webified Video: Media Conversion from TV Programs to Web Content for Cross-Media Information Integration," Proceedings of the 16th International Conference on Database and Expert Systems Applications, 2005, pp. 176-185, Springer-Verlag, Berlin, Heidelberg, Germany.
45 Miyauchi et al., "Highlight Detection and Indexing in Broadcast Sports Video by Collaborative Processing of Text, Audio, and Image," Sytstems and Computers in Japan, vol. 34, No. 12, 2003, pp. 22-31, Translated from Denshi Joho Tsushin Gakkai Ronbunshi, vol. J85-D-II, No. 11, Nov. 2002, pp. 1692-1700.
46 Moraveji, N. et al., "DvnaLine: A Non-Disruptive TV User Interface for Passive Browsing of Internet Video," Microsoft Research Technical Report, 2006, pp. 1-4, United States.
47 Nitta, Naoka et al., "Automatic Story Segmentation of Closed-Caption Text for Semantic Content Analysis of Broadcasted Sports Video," 8th International Workshop on Multimedia Information Systems, 2002, pp. 110-116.
48 Notice of Allowance dated Jan. 30, 2012 from U.S. Appl. No. 11/981,019.
49 Notice of Allowance dated Nov. 1, 2011 from U.S. Appl. No. 11/821,938.
50 Notification of Transmittal of the International Search Report and the Written Opinion of the International Search Authority Application No. PCT/KR2008/000537 dated May 15, 2008, 16 pages.
51 Notification of Transmittal of the International Search Report and the Written Opinion of the International Searching Authority for International Application No. PCT/KR2008/001558, dated Jun. 26, 2008, 10 pages.
52 Notification of Transmittal of the International Search Report and the Written Opinion of the International Searching Authority, dated Aug. 20, 2008; International Search Report and Written Opinion of the International Searching Authority for International Application No. PCT/KR2008/001941, 10 pages.
53 Office Action dated Apr. 19, 2010 from U.S. Appl. No. 11/969,778.
54 Office Action dated Aug. 19, 2011 from U.S. Appl. No. 11/821,938.
55 Office Action dated Aug. 2, 2011 from U.S. Appl. No. 11/713,312.
56 Office Action dated Aug. 22, 2011 from U.S. Appl. No. 11/981,019.
57 Office Action dated Dec. 29, 2009 from U.S. Appl. No. 11/981,019.
58 Office Action dated Dec. 4, 2009 from U.S. Appl. No. 11/732,887.
59 Office Action dated Dec. 9, 2009 from U.S. Appl. No. 11/726,340.
60 Office Action dated Jul. 6, 2011 from U.S. Appl. No. 11/789,609.
61 Office Action dated Jun. 1, 2011 from U.S. Appl. No. 11/803,826.
62 Office Action dated Jun. 11, 2010 from U.S. Appl. No. 12/056,184.
63 Office Action dated Jun. 15, 2011 from U.S. Appl. No. 11/969,778.
64 Office Action dated Jun. 27, 2011 from U.S. Appl. No. 11/725,865.
65 Office Action dated Jun. 5, 2009 from U.S. Appl. No. 11/732,887.
66 Office Action dated Mar. 17, 2011 from U.S. Appl. No. 11/633,880.
67 Office Action dated Mar. 25, 2010 from Chinese Patent Application No. 200810082621.3, 7pp., China (English-language translation included-15 pp).
68 Office Action dated Mar. 25, 2010 from Chinese Patent Application No. 200810082621.3, 7pp., China (English-language translation included—15 pp).
69 Office Action dated Mar. 25, 2011 from U.S. Appl. No. 12/263,089.
70 Office Action dated Mar. 29, 2012 from U.S. Appl. No. 11/726,340.
71 Office Action dated Mar. 30, 2012 from U.S. Appl. No. 11/633,880.
72 Office Action dated Mar. 4, 2011 from U.S. Appl. No. 11/725,865.
73 Office Action dated May 19, 2009 from U.S. Appl. No. 11/726,340.
74 Office Action dated Oct. 14, 2010 from U.S. Appl. No. 11/726,340.
75 Office Action dated Oct. 6, 2010 from U.S. Appl. No. 11/981,019.
76 Opera Software ASA, Opera Browser for Devices, http://www.opera.com/products/devices/, downloaded Sep. 19, 2008, pp. 1-2, United States.
77 Rau Lisa, F. et al., "Domain-independent summarization of news," Jun. 1994, In Summarizing Text for Intelligent Communication, pp. 71-75, Dagstuhl, Germany.
78 Realnetworks, Inc., http://www.real.com, downloaded Sep. 19, 2008, United States.
79 Spalti, M., "Finding and Managing Web Content with Copernic 2000", Sep. 2000, Library Computing, Westport, pp. 217-221, vol. 18, No. 3, United States.
80 Tivo Inc., http://www.tivo.com, downloaded Sep. 19, 2008, 1 page.
81 Tjondronegoro, D. et al., "Extensible detection and indexing of highlight events in broadcasted sports video," Jan. 2006, Proceedings of the 29th Australasian Computer Science Conference, Hobart, Australia.
82 U.S. Advisory Action for U.S. Appl. No. 11/633,880 mailed Aug. 21, 2014.
83 U.S. Advisory Action for U.S. Appl. No. 11/633,880 mailed Jul. 11, 2014.
84 U.S. Advisory Action for U.S. Appl. No. 11/633,880 mailed Nov. 25, 2009.
85 U.S. Final Office Action for Application U.S. Appl. No. 11/803,826 mailed Mar. 3, 2010.
86 U.S. Final Office Action for U.S. Appl. No. 11/633,880 mailed May 7, 2014.
87 U.S. Final Office Action for U.S. Appl. No. 11/633,880 mailed Oct. 28, 2010.
88 U.S. Final Office Action for U.S. Appl. No. 11/713,350 mailed Aug. 14, 2009.
89 U.S. Final Office Action for U.S. Appl. No. 11/713,350 mailed Sep. 9, 2010.
90 U.S. Final Office Action for U.S. Appl. No. 11/725,865 mailed Mar. 16, 2010.
91 U.S. Non-final Office Action for U.S. Appl. No. 11/633,880 mailed Jan. 6, 2009.
92 U.S. Non-final Office Action for U.S. Appl. No. 11/633,880 mailed May 11, 2010.
93 U.S. Non-Final Office Action for U.S. Appl. No. 11/633,880 mailed Sep. 26, 2013.
94 U.S. Non-final Office Action for U.S. Appl. No. 11/713,350 mailed Mar. 2, 2009.
95 U.S. Non-final Office Action for U.S. Appl. No. 11/713,350 mailed Mar. 8, 2010.
96 U.S. Non-final Office Action for U.S. Appl. No. 11/725,865 mailed Oct. 16, 2009.
97 U.S. Non-final Office Action for U.S. Appl. No. 11/725,865 mailed Sep. 14, 2010.
98 U.S. Non-final Office Action for U.S. Appl. No. 11/803,826 mailed Jul. 24, 2009.
99 U.S. Non-final Office Action for U.S. Appl. No. 11/900,847 mailed Oct. 28, 2009.
100 U.S. Notice of Allowance for U.S. Appl. No. 11/633,880 mailed Oct. 24, 2012, United States.
101 U.S. Notice of Allowance for U.S. Appl. No. 11/633,880 mailed Sep. 23, 2014.
102 U.S. Notice of Allowance for U.S. Appl. No. 11/726,340 mailed Apr. 29, 2013.
103 U.S. Notice of Allowance for U.S. Appl. No. 11/803,826 (SISAP164/ADV06-CE14) mailed Mar. 27, 2014.
104 U.S. Office Action dated Feb. 14, 2011 from U.S. Appl. No. 11/726,340.
105 U.S. Office Action for U.S. Appl. No. 11/633,880 mailed Aug. 10, 2009.
106 Vechtomova, O. et al. "Query expansion with terms selected using lexical cohesion analysis of documents", Information Processing and Management: an International Journal, Oct. 2006, pp. 849-865, vol. 43, No. 4, Pergamon Press Inc., Tarrytown, New York, United States.
107 Wachman, J. et al., "Tools for Browsing a TV Situation Comedy Based on Content Specific Attributes," Mar. 2001, Multimedia Tools and Applications, vol. 13 No. 3, p. 255-284, United States.
108 Yahoo Search Engine, http://search.yahoo.com, downloaded on Sep. 19, 2008, pp. 1, United States.
109 Zhuang, Y. et al., "Applying semantic association to support content-based video retrieval," Oct. 1998, International workshop on Very Low Bitrate Video Coding (VLBV 1998), United States.
US20140129934 * 8 Nov 2012 8 May 2014 Microsoft Corporation Dynamic model-based management tooling
U.S. Classification 707/766, 707/769, 707/779, 715/748, 707/758, 704/7, 715/700, 707/706, 707/767
International Classification G06F17/28, G06F3/00, G06F17/30
Cooperative Classification G06F3/00, G06F17/28, G06F17/30528
Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:MESSER, ALAN;REEL/FRAME:023126/0555