Source: http://www.google.com/patents/US7788602?dq=U.S.+patent+number+7,325,728&ei=Y93TTteOAe702wW6uqi1BQ
Timestamp: 2015-05-07 09:07:35
Document Index: 299913429

Matched Legal Cases: ['art 2', 'Application No. 2003204800', 'Application No. 2004200459', 'Application No. 2003204478', 'Application No. 2003204478', 'Application No. 67', 'Application No. 03143003', 'Application No. 03145242', 'Application No. 03145242', 'Application No. 200410005390', 'Application No. 200510088529', 'Application No. 200510009487', 'Application No. 200510088529', 'Application No. 04', 'Application No. 03', 'Application No. 03', 'Application No. 05', 'Application No. 04002224', 'Application No. 02', 'Application No. 03', 'Application No. 05', 'Application No. 05', 'Application No. 05', 'Application No. 04002224', 'Application No. 05', 'Application No. 04', 'Application No. 03003931', 'Application No. 2002', 'Application No. 2004', 'Application No. 2002', 'Application No. 2004', 'Application No. 2003', 'Application No. 2003', 'Application No. 2003', 'Application No. 2003', 'Application No. 2003', 'Application No. 10', 'art 1', 'Application No. 2003', 'Application No. 2004105880', 'Application No. 2005104223', 'Application No. 2004104096', 'Application No. 2003118722', 'Application No. 200500214']

Patent US7788602 - Method and system for providing restricted actions for recognized semantic ... - Google PatentsSearch Images Maps Play YouTube News Gmail Drive More »Sign inAdvanced Patent SearchPatentsStrings are recognized and annotated, or labeled, with a type label by a recognizer plug-in. Application program modules may use the type label and other metadata to provide users with a choice of electronic commerce actions. In addition, the user may be provided with a download Uniform Resource Locator...http://www.google.com/patents/US7788602?utm_source=gb-gplus-sharePatent US7788602 - Method and system for providing restricted actions for recognized semantic categoriesAdvanced Patent SearchPublication numberUS7788602 B2Publication typeGrantApplication numberUS 09/906,552Publication dateAug 31, 2010Filing dateJul 16, 2001Priority dateJun 6, 2000Fee statusPaidAlso published asUS20020087591Publication number09906552, 906552, US 7788602 B2, US 7788602B2, US-B2-7788602, US7788602 B2, US7788602B2InventorsJeff Reynar, Ziyi Wang, Michael AmmerlaanOriginal AssigneeMicrosoft CorporationExport CitationBiBTeX, EndNote, RefManPatent Citations (106), Non-Patent Citations (360), Referenced by (6), Classifications (9), Legal Events (3) External Links: USPTO, USPTO Assignment, EspacenetMethod and system for providing restricted actions for recognized semantic categories
US 7788602 B2Abstract
Strings are recognized and annotated, or labeled, with a type label by a recognizer plug-in. Application program modules may use the type label and other metadata to provide users with a choice of electronic commerce actions. In addition, the user may be provided with a download Uniform Resource Locator (URL) and download action plug-ins for that type label. An ActionGUID may be used to specify the class ids (CLSIDs) of the action plug-ins that may provide actions for a particular semantic category type label. Each DLL has a class id (CLSID), which is a GUID. The ActionGUID is a GUID that is specified by the recognizer plug-in and which corresponds to the CLSID(s) of the only action plug-ins that should be permitted to provide actions for the semantic category type label provided by the recognizer plug-in.
1. A computer-implemented method, implemented in an electronic system for creating and editing an electronic document, for providing a plurality of actions in association with a string in the electronic document, the method comprising:
receiving an automatically selected string in the electronic document;
recognizing the string as belonging to at least one semantic category;
when the string belongs to more than one semantic category, labeling the recognized string with a plurality of type labels associated with the plurality of semantic categories, wherein labeling the recognized string with the type label associated with the plurality of semantic categories comprises receiving a selection, from a menu, the selection labeling the recognized string with a type label from the plurality of type labels when the recognized string is associated with a plurality of semantic categories;
determining an action ID associated with the type label of the at least one semantic category associated with the type label selected from the menu;
determining whether a plurality of action plug-ins associated with the at least one semantic category are available in the electronic system using the type label and metadata associated with the electronic document;
when the plurality of action plug-ins are associated with the at least one semantic category, then for each of the plurality of action plug-ins, determining whether a class ID matches the action ID and then displaying unique elements associated with the at least one semantic category for the matching action plug-in in a semantic category menu, wherein displaying the unique elements associated with the at least one semantic category for the matching action plug-in in the semantic category menu comprises:
displaying the recognized string and one or more types of semantic categories associated with the recognized string,
displaying a list of unique actions available for each of the at least one semantic category type,
displaying an action to navigate a user's web browser to download new actions, in response to a determining that a download uniform resource locator (URL) is available, and
displaying an action to delete at least one type of semantic category; and
embedding the plurality of semantic categories in the electronic document, wherein each of the plurality of embedded semantic categories comprises the automatically selected string in the electronic document, the label associated with the recognized string, and the unique action associated with the at least one semantic category for the matching action plug-in.
determining that the action has been selected and performing the action defined by the action plug-in on the electronic document.
3. The method of claim 1 wherein the semantic category menu is displayed in response to a user selecting the at least one semantic category.
if the plurality of action plug-ins are not associated with the at least one semantic category, then providing a hypertext link to download action plug-ins associated with the at least one semantic category.
5. A system operable for creating and editing an electronic document, the system comprising:
embedding the plurality of semantic categories in the electronic document,
wherein each of the plurality of embedded semantic categories comprises the automatically selected string in the electronic document, the label associated with the recognized string, and the unique action associated with the at least one semantic category for the matching action plug-in.
6. The system of claim 5 wherein the processing unit is further operable to determine that the action has been selected and perform the action defined by the action plug-in on the electronic document.
7. The system of claim 5 wherein the semantic category menu is displayed in response to a user selected semantic category.
8. The system of claim 5 wherein if the plurality of action plug-ins are not associated with the at least one semantic category, the processing unit is further operable to then provide a hypertext link to download action plug-ins associated with the at least one semantic category.
9. The system of claim 5 wherein the processing unit is further operable to determine a class ID for the action plug-in associated with the at least one semantic category.
10. The system of claim 5 wherein the processing unit operable to determine the action ID associated with the type label of the at least one semantic category comprises the processing unit operable to receive the action ID from a recognizer plug-in associated with the at least one semantic category.
11. The system of claim 5 wherein the processing unit operable to determine the action ID associated with the type label of the at least one semantic category comprises the processing unit operable to search a database for the action ID associated with the at least one semantic category. Description
This is a continuation-in-part of U.S. patent application Ser. No. 09/588,411, entitled �METHOD AND SYSTEM FOR SEMANTICALLY LABELING STRINGS AND PROVIDING ACTIONS BASED ON SEMANTICALLY LABELED STRINGS�, filed Jun. 6, 2000, which is incorporated by reference herein.
This invention relates to a method and system for recognizing semantic categories and providing actions based on those semantic categories. More particularly, this invention relates to restricting the actions for semantic categories to those provided by authorized action providers.
Electronic documents typically include semantic information that would be helpful if the information was recognized as such. Recognition and use of this semantic information could result in increased interoperability between desktop software applications and other desktop applications and/or web-based applications. Recognition of this semantic information may also provide benefits in electronic commerce. Independent third parties need to be able to easily develop list of terms for recognition and actions to be provided for this semantic information. However, developers also need to be able to restrict the actions to only authorized actions.
The present invention is associated with a method for semantically labeling strings in an electronic document and providing actions in association with those recognized strings. A string is defined as a data structure composed of a sequence of characters usually representing human-readable text. Strings are recognized and annotated, or labeled, with a type label by a recognizer plug-in. After the strings are annotated with a type label, application program modules may use the type label and other metadata to provide users with a choice of electronic commerce actions. If the user's computer does not have any actions associated with that type label, the user may be provided with the option to surf to a download Uniform Resource Locator (URL) and download action plug-ins for that type label.
In one embodiment, the present invention uses an ActionGUID to specify the class ids (CLSIDs) of the action plug-ins that may be used to provide actions for a particular semantic category type label. A GUID is a globally unique identifier used to represent components in the COM architecture. Each DLL has a class id (CLSID), which is a GUID. The ActionGUID is a GUID that is specified by the recognizer plug-in and which corresponds to the CLSID(s) of the only action plug-ins that should be permitted to provide actions for the semantic category type label provided by the recognizer plug-in.
FIG. 2 is a block diagram illustrating an exemplary architecture for use in conjunction with an embodiment of the present invention.
FIG. 3 is a flow chart illustrating a method for semantically labeling strings during creation of an electronic document.
FIG. 4 is an illustration of a display of a semantic category and its associated dropdown menu.
FIG. 5 is a flow chart illustrating a method for specifying particular action plug-ins to use with a particular semantic category in accordance with an embodiment of the present invention.
FIG. 6 is a flow chart illustrating a method for displaying actions for a particular semantic category in accordance with an embodiment of the present invention.
FIG. 1 and the following discussion are intended to provide a brief, general description of a suitable computing environment in which the invention may be implemented. While the invention will be described in the general context of an application program that runs on an operating system in conjunction with a personal computer, those skilled in the art will recognize that the invention also may be implemented in combination with other program modules. Generally, program modules include routines, programs, components, data structures, etc. that perform particular tasks or implement particular abstract data types. Moreover, those skilled in the art will appreciate that the invention may be practiced with other computer system configurations, including hand-held devices, multiprocessor systems, microprocessor-based or programmable consumer electronics, cell phones, minicomputers, mainframe computers, and the like. The invention may also be practiced in distributed computing environments where tasks are performed by remote processing devices that are linked through a communications network. In a distributed computing environment, program modules may be located in both local and remote memory storage devices.
A number of program modules may be stored in the drives and RAM 25, including an operating system 35, one or more application programs 36, a word processor program module 37 (or other type of program module), program data 38, and other program modules (not shown).
FIG. 2 is a block diagram illustrating an exemplary architecture 200 for use in conjunction with an embodiment of the present invention. The architecture includes an application program module 205, such as word processor program module 37 (FIG. 1). The application program module 205 is able to communicate with a recognizer dynamic-link library 210 (hereinafter recognizer DLL) and an action dynamic-link library 215 (hereinafter action DLL) as a user is creating or editing an electronic document. The recognizer DLL 210 controls a number of recognizer plug-ins 220. The action DLL 215 controls a number of action plug-ins 225. The action DLL also controls a type-action database 230.
In a preferred embodiment, the action plug-ins and recognizer plug-ins are Automation Servers. Automation Servers are well-known software components which are assembled into programs or add functionality to existing programs running on the Microsoft WINDOWS� operating system. Automation Servers may be written in a variety of computing languages and may be un-plugged from a program at run time without having to recompile the program. It should also be understood that, in a preferred embodiment, the action DLL and recognizer DLL are merged into a single DLL.
The recognizer DLL 210 handles the distribution of strings from the electronic document running on the application program module 205 to the individual recognizer plug-ins 220. The recognizer plug-ins 220 recognize particular strings in an electronic document, such as a word processing document, a spreadsheet document, a web page, etc. The recognizer plug-ins 220 may be packaged with the application program module 205 or they may be written by third parties to recognize particular strings that are of interest. Typically, the recognizer DLL 210 passes strings to the recognizer plug-ins 220 in one paragraph or cell value increments.
As part of recognizing certain strings as including semantic information, the recognizer plug-ins 220 determine which strings are to be labeled and how they are to be labeled. After receiving these results from the various recognizer plug-ins 220, the recognizer DLL 210 sends semantic categories to the application program module. In a preferred embodiment, a semantic category comprises the recognized string, a type label, and a download URL. A semantic category may also comprise metadata. The recognizer plug-ins 220 each run separately and the recognizer DLL 210 is responsible for handling the asynchronicity that results from different recognizer plug-ins returning results with different delays.
After a string is labeled by a recognizer plug-in 220 and a semantic category is sent to the application program module 205, the user of the application program module 205 will be able to execute actions that are associated with the type label of the semantic category. The action DLL 215 manages the action plug-ins 225 that are run to execute the actions. As with the recognizer plug-ins 220, the action plug-ins 225 may be packaged with the application program module 205 or written by third parties to perform particular actions that are of interest to the third party. The action plug-ins provide possible actions to be presented to the user based upon the type label associated with the string. The action DLL 215 determines what type label the semantic category includes and cross-references the type label in the type-action database 230 with a list of actions to determine what actions to present to the user. It should be understood that, in a preferred embodiment, the type-action database is not used. Instead, the list of actions is dynamically generated for each type by looking in the registry to determine which actions are installed and then querying the action DLLs to determine which types they apply to.
After the user chooses an action, the action DLL 215 manages the appropriate action plug-ins 225 and passes the necessary information between the action plug-ins and the application program module 205 so that the action plug-in may execute the desired action. Typically, the application program module sends the action DLL an automation request to invoke the action the user has selected.
As described above, the combination of the recognized string, type label, metadata and download URL is referred to herein as a semantic category. The type label is a semantic information label. The semantic category may also comprise metadata, which are hidden properties of the semantic category. An example of a semantic category may clarify the definition. Suppose a user enters the text �Gone With the Wind� into an electronic document. The string �Gone With the Wind� may be identified as a semantic category of type label �Book Title� and of type label �Movie Title�. In addition, metadata such as the ISBN number may be returned by the recognizer plug-in to the application program module as part of the semantic category. A download URL may be provided with the type labels �Book Title� and �Movie Title� in case the user's machine has not stored action plug-ins for these type labels. For example, an action for the type label �Book Title� may be �Buy this Book� from an online retailer. If the user does not have the action plug-in DLL 225 corresponding to �Buy this book�, then the download URL may be used to navigate the user's web browser to an appropriate website to download this action plug-in. In other implementations of the invention, multiple download URLs may be provided for a single type label.
It should also be understood that the present invention, in a preferred embodiment, also recognizes sequences of capitalized words that contain function words, and which are likely to be special, but for which there is no type label information. These strings are typically labeled by a grammar checker program module.
The actions provided for a semantic category may utilize both the type label and the text of the recognized string. For example, a word processor program module may use a grammar checker as a recognizer plug-in to label strings that are person names. After a string has been labeled as a person's name, the word processor program module may, through a standard user interface mechanism, allow users to execute pertinent actions, such as looking up the person's name in the contacts folder in a personal information manager program module, sending electronic mail, or searching for the person's name in an HR database.
Having described an exemplary architecture, an exemplary method 300 for semantically labeling strings during document creation will be described below in reference to FIGS. 2 and 3.
Method for Semantically Labeling Strings During Document Creation
FIG. 3 is a flow chart illustrating a method 300 for semantically labeling strings during creation of an electronic document. Those skilled in the art will appreciate that this is a computer-implemented process that is carried out by the computer in response to input from the user and instructions provided by a program module.
Referring to FIG. 3, the method 300 begins at start step 305 and proceeds to step 310 when a user opens an electronic document in application program module 205. In a preferred embodiment, the electronic document is a word processing document or a spreadsheet document. However, the invention is not limited to either of these specific types of electronic documents.
At step 310, the application program module 205 receives a new string, such as when the user enters a new paragraph into the electronic document or edits a previously entered paragraph. The method 300 then proceeds to step 315.
At step 315, the paragraph containing the new string is passed from the application program module 205 to the recognizer DLL 210. The recognizer DLL is responsible for communicating with the application program module, managing the jobs that need to be performed by the recognizer plug-ins, receiving results from the recognizer plug-ins and sending semantic category information to the application program module. At boot time, the recognizer DLL communicates with its recognizer plug-ins to determine what languages it supports, what types it can apply, etc. It should be understood that, in a preferred embodiment, a paragraph is passed to the recognizer DLL at step 315. However, in alternative embodiments, a sentence, the contents of a spreadsheet cell, a section of the document, the entire document, etc. may be passed to the recognizer DLL. In other words, the present invention is not limited to simply passing a paragraph to the recognizer DLL. The method 300 then proceeds to step 320.
Still referring to step 315, the application program module 205 typically sends one paragraph at a time to the recognizer DLL. In addition, in a preferred embodiment, a grammar checker program module sends all semantic categories (without type labels) to the recognizer DLL that have been identified by the grammar checker program module. Passing these semantic categories (without type labels) to the recognizer DLL is important because doing so saves each recognizer plug-in from needing to decide whether something is a capitalized string interspersed with function words (a task that would require writing a number of regular expressions: Cap Cap Unc Cap; Cap Unc Cap; etc.). If a label is applied by a recognizer plug-in to a string the grammar checker program module labeled, the grammar checker label will then be removed.
At step 320, during idle time, the paragraph (and information from the grammar checker program module) is passed to the recognizer plug-ins. The method then proceeds to step 325.
It should be understood that, in a preferred embodiment, the recognizer DLL 210 maintains a job queue. If before the recognizer DLL 210 sends the paragraph to the recognizer plug-ins 220 the user edits the paragraph, then the job containing the edited paragraph is deleted and is not sent to the recognizer plug-ins. Then, a new job enters the queue at step 315 after the edited paragraph is received at step 310. This job deletion is necessary to prevent the recognizer plug-ins from performing unnecessary work on a paragraph that has been edited.
At step 325, the recognizer plug-ins are executed on the paragraph to recognize keywords or perform other actions defined by the recognizer plug-in. As part of executing the recognizer plug-in, the paragraph may be broken into sentences by the recognizer plug-in. However, each recognizer plug-in is responsible for its own sentence-breaking. After the keywords or special words are found at step 325, then the method proceeds to step 330.
At step 330, the results from each of the recognizer plug-ins are received by the recognizer DLL. The method then proceeds to decision step 335.
At decision step 335, it is determined whether the paragraph that has been reviewed by the recognizer plug-ins has been edited after the paragraph was sent to the recognizer DLL. If so, then the method 300 returns to step 315 and the edited paragraph is received by the recognizer DLL from the application program module. If not, then the method proceeds to step 340.
At step 340, the results from the recognizer plug-ins are compiled into semantic categories by the recognizer DLL and the semantic categories are sent to the application program module. At step 345, the application program module displays the semantic categories to the user in the electronic document. The method 300 then ends at step 399.
As should be understood from the above description, the architecture for recognizing semantic categories permits third parties to develop recognizer plug-ins to identify strings of one or more particular types. The recognizer plug-ins communicate with the application program module and receive a string from the application program module. The recognizer plug-ins may apply recognition algorithms to the string and communicate the identity of recognized strings back to the application program module.
After a string is labeled with a particular type label, the user will be able to execute action plug-ins that pertain to that type label. The action plug-ins preferably are COM objects that are executed via communication between the application program module and the action DLL. Parameters and other information necessary to execute the action (the HTML of the string labeled as being of a particular type, the HTML of the string representing the current selection) will be passed from the application program module to the action DLL and, in turn, passed to the action plug-in.
Actions Assigned to Type Labels
An architecture for identifying and executing a set of actions associated with a semantic category may also be provided. This architecture comprises actions that apply to a particular type label (e.g. an action for book titles may be �Buy this book from shop.Microsoft.com�) and executing those actions when the user so desires. An action is a user-initiated function applied to a typed string. For example, adding a name to the contacts folder is one action possible for a type label �Person name�.
There is power and flexibility that results from allowing third party vendors, such as IT professionals, to design and write recognizer plug-ins and action plug-ins for deployment within an organization or for deployment on the World Wide Web. Some example actions that may be executed include:
Add to contacts folder
Look up in contacts folder, address book, Windows Address Book (WAB), Global
Address List (GAL), etc.
Insert address into document
Display EXPEDIA map
Send instant message to
Different actions may be assigned to different type labels and these type label-action assignments may be stored in the type-action database 230. Table 1 below illustrates some possible type label-action pairings.
Show calendar for that day
New task with that due date
Schedule meeting that day
For each type label, the type-action database 230 may store a download URL specified by the creator of the type label that users who do not have action-plug-ins or recognizer plug-ins for that semantic category type can go to in order to get action plug-ins and/or recognizer plug-ins. For example, the download URL for the type label �Book Title� might be microsoft.com/semanticcategories.asp. Once at that web page, a user may be offered downloads of various action plug-ins and recognizer plug-ins. There may also be an option on the user interface to navigate to the download URL so that recipients of documents with semantic categories can easily get the action plug-ins for those semantic categories.
Storing Semantic Categories
Semantic categories may be stored as part of the electronic document along with other document information and may be available when a document is transmitted from one computer to another computer. In a preferred embodiment, storing semantic categories in an electronic document is controlled by an �Embed semantic categories� checkbox. The checkbox is on by default. Turning it off will prevent semantic categories in the document from being saved. The state of the checkbox is per document. The same checkbox controls saving for both .htm and .doc documents.
Checking a �Save semantic categories as XML properties� checkbox (off by default) will write out the text of all of the semantic categories in the document and their labels in the header of the HTML file in XML (that is using the same tags as are used inline, but surrounded by <xml>And </xml>) for easy identification and parsing by search engines and knowledge management systems.
Semantic categories may be saved as a unique namespace plus a tag name. A namespace is an XML construct for uniquely identifying a group of XML tags that belong to a logical category. Thus, every semantic category is uniquely identified by its nametag (e.g., �streetname�) in addition to its namespace (e.g., �schemas-microsoft-com:outlook:contact�)
Although the method 300 described above is one method for identifying semantic categories, there may be other mechanisms for identifying semantic categories. One mechanism is a grammar checker program module (not shown) connected to word processor program module 37. Another mechanism is receiving a semantic category from another electronic document. For example, when text containing a semantic category is copied from one electronic document and pasted into another electronic document of the word processor program module 37, the information identifying the semantic category is preserved and copied along with the copied text.
Displaying Semantic Categories to the User
Referring now to FIG. 4, an illustration of a display of a semantic category 400 and its associated dropdown menu 405 will be described. It should be understood that FIG. 4 is an illustration of a semantic category 400 and dropdown menu 405 as displayed to a user by the application program module 205.
The string 410 associated with semantic category 400 is the string �Bob Smith�. As shown in FIG. 4, the string 410 of a semantic category 400 may be identified to the user by brackets 415. Of course, many other devices such as coloring, underlining, icons, etc. may be used to indicate to the user that a particular string is a semantic category.
In a preferred embodiment, when the user hovers a cursor over the string 410 or places the insertion point within string 410, then dropdown menu 405 is displayed to the user. The dropdown menu may display a list of actions associated with a semantic category. The dropdown menu may appear above and to the left of the semantic category string.
Typically, the first line of the dropdown menu indicates which string is the semantic category string (Bob Smith in FIG. 4) and what type the semantic category is (Person name in FIG. 4). Listed below the first line are actions 420 available for the semantic category type, such as �Send mail to . . . �, �Insert Address�, and �Display contact information . . . �.
The first item on the drop down menu below the separator line is �Check for new actions . . . � 425. �Check for new actions . . . � 425 will appear only for semantic categories whose download URL is available to the application program module. If selected, �Check for new actions . . . � 425 uses the semantic category download URL to navigate the user's web browser to the homepage for the semantic category type applied to the string. For example, suppose new actions have been defined for the semantic category type �person name�. If so, then new actions will be downloaded to the user's computer after selecting �Check for new actions . . . � 425. �Check for new actions . . . � 425 will be grayed out if a download URL is unavailable for the semantic category.
If selected, the �Remove this semantic category� item 430 deletes the semantic category label from the string. If selected, the �Semantic categories� item 435 navigates the user to the semantic categories tab of the autocorrect dialog.
It should be understood that the application program module sends a request to the action DLL to determine which actions are shown with each semantic category type.
Actions Performed in Association with Semantic Categories
There are a number of functions that users perform on typed data that preferred word processor program module 37 and semantic categories will make easier. The functions fall into three primary categories:
1) interacting with personal information manager contacts, tasks, meetings, and mail; 2) interacting with properties on the World Wide Web or a corporate intranet; and 3) interacting with other applications on the client machine. A single string may be associated with multiple semantic categories. Every semantic category has a type label with one or more action plug-ins defined for the type label. For example, the �Address� type label may have the �Open in MapPoint�, �Find with Expedia Maps� and �Add to my Address Book� actions associated with it and each of these actions may have a different action plug-in to execute the action.
The actions assigned to type labels also depend on the computer that the application program module is running on. Thus, if a computer has three actions registered for the type label �Address�, then all strings with an �Address� type label will be assigned to three actions. However, if one of these semantic categories is sent to a computer which has only two actions registered for the �Address� type label, then the user will only be exposed to two actions for this semantic category.
Nesting of Semantic Categories
In an embodiment of the present invention, semantic categories may be nested inside each other. For example, the string �George Washington� may include a semantic category with type label �Person Name� for the span �George Washington State� and a semantic category with type label �State� for the span �Washington�. Moreover, two semantic categories may cover exactly the same span. For example, the string �George Washington� may include a semantic category with type label �Person Name� and a semantic category with type label �President�.
Because the preferred application program module 37 will support labeling a single string with multiple type labels (e.g. Bob Smith could be a semantic category labeled as a �Person Name� and labeled as a �Microsoft employee�), the preferred application program module 37 will use cascade menus on the dropdown menu if multiple semantic category types are assigned.
For example, the cascade menu may include a list of the type labels included in the recognized string. This list may include a type label �Person Name� and a type label �Microsoft employee�.
It should be understood that a cascade menu may be used to allow the user to select which type label the user is interested in and to further select an action after selecting the type label.
In-document User Interface to Indicate Semantic Categories
As described above with reference to FIG. 4, the application program module may include the option to display an in-document user interface to indicate the location of semantic categories. This in-document user interface may use a colored indication to indicate the location of a semantic category, such as the brackets 415 in FIG. 4. The in-document user interface will also be able to show nesting of semantic categories. For example, if Michael Jordan is labeled as a semantic category with type label �Person Name�, Michael is a semantic category with type label �First Name� and Jordan is a semantic category with type label �Last Name�, the document may look like this with the brackets indicating semantic categories:
[[Michael] [Jordan]]
Of course, the in-document user interface may be any sort of indication. For example, in the �EXCEL� spreadsheet application program, the interface comprises a triangle in the lower right hand portion of a cell to indicate that one or more semantic categories are present in the cell.
Although the present invention has been described as implemented in a word processing program module, it should be understood that the present invention may be implemented in other program modules, including, but not limited to, HTML authoring programs and programs such as the �POWERPOINT�� presentation graphics program and the �OFFICE� program module, both marketed by Microsoft Corporation of Redmond, Wash.
As described above, the semantic category may also include metadata returned by the recognizer plug-ins. For example, a recognizer plug-in that recognizes the titles of books may return as metadata an ISDN book number when it recognizes the title of a book. The ISDN book number metadata may then be used to provide actions. Metadata may also be used to disambiguate for actions and searches. For example, suppose a recognizer DLL is linked to a corporate employee database to recognize names. When the recognizer DLL recognizes �Bob Smith�, it may store �employeeID=12345� as metadata in the background. Then, when an action is fired, the text in question will be known to reference Bob Smith, employee no. 12345 rather than Bob Smith, employee no. 45678. Also, the metadata may allow searches to be performed independent of the actual text in a document. So, a search may be conducted on �Robert Smith� by looking for employee 12345 in the employee databases and by performing a search on the metadata for employee number 12345 to find documents with �Bob Smith� in them. There are also numerous other functions for metadata. For instance, DHTML could be inserted so special tricks may be performed within a web browser. Additionally, data used by other actions may be inserted such as someone's e-mail address that could be used by the send-mail-to action, a normalized version of the date could be stored to easily interact with a personal information manager, etc.
Restricting Actions for Certain Semantic Categories
In some embodiments, the semantic category architecture as illustrated in FIG. 2 allows any action plug-in to declare that it provides actions for any recognizer plug-in (or any type label recognized by any recognizer plug-in). This architecture allows great flexibility in that action plug-ins can be developed separately from recognizer plug-ins and third parties can extend the semantic category type labels recognized. However, this architecture has some drawbacks. For example, suppose that a developer invests heavily in building and maintaining a database of product names of a particular type, such as a list of compact discs, and invests in developing a recognizer plug-in to recognize these product names. The developer may want to leverage this database by recognizing compact discs mentioned in documents and mail messages in order to sell those items to users. However, under the semantic category architecture described above, the recognition by the developer's recognizer plug-in may be used by a third party to provide actions such as purchasing the compact disc from a third party. Thus, the third party or another compact disc retailer could effectively �hijack� the recognition efforts of the developer's recognizer plug-in and provide a buying action for compact discs recognized by the developer's recognizer plug-in. The third party simply has to develop an action plug-in and use the existing recognizer plug-in of the developer. Developers might be hesitant to spend a lot of time and resources developing effective recognizer plug-ins if it is easy for their competitors to capitalize on their efforts. Thus, a method and system for specifying which actions plug-ins may be used in association with a specific recognizer plug-in is needed.
In one embodiment, the present invention uses an ActionGUID to specify the class ids (CLSIDs) of the action plug-ins that may be used to provide actions for a particular semantic category type label. A GUID is a globally unique identifier used to represent components in the COM architecture. Each action plug-in has a class id (CLSID), which is a GUID. The ActionGUID is a GUID that is specified by the recognizer plug-in and which corresponds to the CLSID(s) of the only action plug-ins that should be permitted to provide actions for the semantic category type label provided by the recognizer plug-in.
Thus, in one embodiment of the present invention, a recognizer plug-in is able to specify one or more ActionGULIDs that identify the one or more action plug-ins that should provide actions for a particular type label supplied by the recognizer plug-in. The ActionGUID may be stored within a document so that even if the document travels to a different machine, the ActionGUID will be obeyed (note that CLSIDs are typically not specific to a particular machine, but are constant for a particular plug-in or DLL).
With ActionGUID support added, in one embodiment, the present invention will provide a list of actions in the semantic category dropdown menu for the action plug-in(s) whose CLSID(s) matches the ActionGUID.
One key aspect of recognizers is that in addition to applying category information to a string, they can also associate arbitrary metadata with that string. For example, the recognizer for person names might also embed the person's employee id number in the document. The benefit of embedding additional metadata is that the pool of metadata is available to the action handlers. So, for example, an action handler to send someone e-mail might most easily be written in some environments if the employee id number were embedded along with the name, assuming that employee e-mail addresses were derived from employee numbers. In one embodiment of the invention, the ActionGUID may be embedded in the metadata and stored with the recognized string.
Referring now to FIG. 5, a flow chart illustrating a method 500 for specifying particular action plug-ins to use with a particular semantic category in accordance with an embodiment of the present invention will be described.
The method begins at start step 502 and proceeds to step 505 where a recognizer plug-in recognizes a semantic category in a string that has been passed from the recognizer DLL. The method then proceeds to step 510.
At step 510, the recognizer plug-in passes semantic category information to the recognizer DLL such as the string that was recognized, the type label to be applied to the string, the download URL, etc. Included in this semantic category information is one or more ActionGUIDs. The ActionGUIDs identify the one or more action plug-ins that should provide actions for the particular type label supplied by the recognizer plug-in.
The method then proceeds to step 515. At step 515, the semantic category information (including the ActionGUID) is passed from the recognizer DLL to the application and stored with the document. The method then ends at step 599.
After the ActionGUID is stored with the document, the ActionGUID may later be used if the user decides to view the possible actions associated with a semantic category as will be described below.
Referring now to FIG. 6, a flow chart illustrating a method 600 for displaying actions for a particular semantic category in accordance with an embodiment of the present invention will be described. The method 600 begins at start step 602 and proceeds to decision step 603 when it is determined that the user has selected to view the actions associated with a particular semantic category type label. At decision step 603, it is determined whether there is an ActionGUID associated with the semantic category type label. If not, the method ends at step 699 because no ActionGUID is present and actions are not restricted. However, if an ActionGUID is present, then the method proceeds to step 605.
At step 605, the ActionGUID associated with the selected semantic category type label is determined. The method then proceeds to step 610.
At step 610, one of the action plug-ins that specifies to provide actions for that particular semantic category type label is reviewed and its CLSID is retrieved. It should be understood that, in one embodiment of the invention, any number of action plug-ins may designate that they provide actions for any number of semantic category labels and the recognizer plug-in developer must specifically designate which action plug-ins are authorized action plug-ins using an ActionGUID. Therefore, at step 610 one of the action plug-ins that specifies to provide actions for that particular semantic category type label is retrieved and its CLSID is retrieved so that it may be determined whether the action plug-in is an authorized action plug-in as will be described below.
At decision step 615, it is determined whether the CLSID of the retrieved action plug-in matches the ActionGUID of the semantic category. If not, then the method proceeds to decision step 625. If the CLSID does match the ActionGUID of the semantic category, then the method proceeds to step 620.
At step 620, the action defined by the action plug-in will be displayed in the semantic category dropdown menu as illustrated in FIG. 4. The method then proceeds to decision step 625.
At decision step 625, it is determined whether there are any other action plug-ins that specify to provide actions for the particular semantic category type label and which have not been reviewed. If so, then the method returns to step 610 and another action plug-in is reviewed. If not, then the method ends at step 699 and the semantic category dropdown menu is displayed to the user with the authorized actions displayed.
It should be understood that there are a number of ways to designate that one or more action plug-ins are to be used with a particular semantic category type label. For example, in one embodiment of the invention, a recognizer plug-in may designate which action plug-ins are to be used to provide actions during an initialization process. During the initialization process the recognizer plug-in may send an API to the recognizer DLL including relevant information about the recognizer plug-in such as the locales the recognizer applies to, the applications that the recognizer plug-in applies to, etc. Included with this initialization information may be an ActionGUID value. If no ActionGULID is specified, then anyone can provide an action for the semantic category type label recognized by the recognizer plug-in. However, if an ActionGULID is specified, then this ActionGUID is compared to CLSIDs of action plug-ins to determine which action plug-ins may provide actions.
In one embodiment, the information regarding which action plug-ins may provide actions may be stored in the type-action database.
In another embodiment, the files for a web page may include the ActionGUID so that only specific action plug-ins may be used to provide actions. The web page may contain some XML that specifies some information about the semantic categories on the web page (such as what type the semantic categories are, what the download URL is, etc.). This information may be augmented to include an actionGUID. The infrastructure of the present invention may be used to discover the actionGUID when it parses the relevant parts of the web page and may restrict the actions for the semantic categories accordingly.
In another embodiment, a web page may be designed so that an HTML tag specifies not to use specific recognizer plug-ins and action plug-ins while viewing a particular site. In one embodiment of the invention, this would be a voluntary program similar to the ROBOT exclusion standard used to prevent web search engines from crawling web content whose owner has specifically requested that their web content not be crawled. Thus, when a specific predefined HTML tag is encountered on another's webpage, no recognizer plug-ins and action plug-ins would be used or only specified action plug-ins and recognizer plug-ins would be used. This prevents the situation where bookseller one has a webpage and, while viewing bookseller one's webpage, a user is presented with semantic category recognition and actions provided by bookseller two's recognizer plug-in and action plug-in.
Although the present invention has been described above as implemented in preferred embodiments, it will be understood that alternative embodiments will become apparent to those skilled in the art to which the present invention pertains without departing from its spirit and scope. Accordingly, the scope of the present invention is defined by the appended claims rather than the foregoing description.
Patent CitationsCited PatentFiling datePublication dateApplicantTitleUS4674065Dec 10, 1985Jun 16, 1987International Business Machines CorporationSystem for detecting and correcting contextual errors in a text processing systemUS4868750Oct 7, 1987Sep 19, 1989Houghton Mifflin CompanyCollocational grammar systemUS5020019May 25, 1990May 28, 1991Ricoh Company, Ltd.Document retrieval systemUS5128865Mar 2, 1990Jul 7, 1992Bso/Buro Voor Systeemontwikkeling B.V.Method for determining the semantic relatedness of lexical items in a textUS5159552Sep 20, 1990Oct 27, 1992Oce-Nederland B.V.Method for checking the correct and consistent use of units or chemical formulae in a text processing systemUS5267155Mar 6, 1992Nov 30, 1993Medical Documenting Systems, Inc.Apparatus and method for computer-assisted document generationUS5287448Mar 24, 1993Feb 15, 1994Apple Computer, Inc.Method and apparatus for providing help information to users of computersUS5297039Jan 27, 1992Mar 22, 1994Mitsubishi Denki Kabushiki KaishaText search system for locating on the basis of keyword matching and keyword relationship matchingUS5317546Jun 30, 1993May 31, 1994General Electric CompanyTime-of-use calendar events method and apparatus for a meter registerUS5337233Apr 13, 1992Aug 9, 1994Sun Microsystems, Inc.Method and apparatus for mapping multiple-byte characters to unique strings of ASCII characters for use in text retrievalUS5341293Sep 3, 1992Aug 23, 1994Apple Computer, Inc.User interface system having programmable user interface elementsUS5351190Oct 10, 1991Sep 27, 1994Canon Kabushiki KaishaCommunication apparatus and method establishing a language dependent sort order searchUS5386564Feb 24, 1993Jan 31, 1995Hewlett-Packard CompanyConversion of data and objects across classes in an object management systemUS5392386Feb 3, 1994Feb 21, 1995Inter Hi-Tec AgMethod and apparatus for adding functionality to computer programs executing under graphical user interfacesUS5418902Oct 12, 1993May 23, 1995International Computers LimitedElectronic spreadsheet system producing generalized answers including formulasUS5446891Nov 2, 1994Aug 29, 1995International Business Machines CorporationSystem for adjusting hypertext links with weighed user goals and activitiesUS5522089Sep 12, 1994May 28, 1996Cordata, Inc.Personal digital assistant module adapted for initiating telephone communications through DTMF dialingUS5535323Aug 9, 1995Jul 9, 1996Digital Equipment CorporationMethod of and system for displaying context sensitive and application independent help informationUS5541836Dec 30, 1991Jul 30, 1996At&T Corp.Word disambiguation apparatus and methodsUS5546521Oct 17, 1994Aug 13, 1996International Business Machines CorporationDynamic presentation of contextual help and status informationUS5581684Aug 9, 1994Dec 3, 1996Ddtec SaApplication-external help system for a windowing user interfaceUS5596700Feb 17, 1993Jan 21, 1997International Business Machines CorporationSystem for annotating software windowsUS5617565Nov 29, 1994Apr 1, 1997Hitachi America, Ltd.Broadcast interactive multimedia systemUS5625783Dec 13, 1994Apr 29, 1997Microsoft CorporationAutomated system and method for dynamic menu construction in a graphical user interfaceUS5627567Jan 30, 1996May 6, 1997Hewlett-Packard CompanyMethod and apparatus for adaptive touch recognition in a touch sensitive user interfaceUS5627958Mar 17, 1995May 6, 1997Borland International, Inc.System and method for improved computer-based trainingUS5634019Jun 6, 1995May 27, 1997Microsoft CorporationMethod and system for in-place interaction with contained objectsUS5640560Aug 2, 1995Jun 17, 1997Microsoft CorporationCD-ROM content repurposingUS5657259Jan 21, 1994Aug 12, 1997Object Technology Licensing Corp.Number formatting frameworkUS5685000Jan 4, 1995Nov 4, 1997U S West Technologies, Inc.Method for providing a linguistically competent dialogue with a computerized service representativeUS5708825May 26, 1995Jan 13, 1998Iconovex CorporationAutomatic summary page creation and hyperlink generationUS5715415Jun 5, 1996Feb 3, 1998Microsoft CorporationComputer application with help pane integrated into workspaceUS5717923Nov 3, 1994Feb 10, 1998Intel CorporationMethod and apparatus for dynamically customizing electronic information to individual end usersUS5752022Aug 7, 1995May 12, 1998International Business Machines Corp.Method for creating a hypertext language for a distributed computer networkUS5761689Sep 1, 1994Jun 2, 1998Microsoft CorporationAutocorrecting text typed into a word processing documentUS5764794Jun 13, 1996Jun 9, 1998Perlin; KennethMethod and apparatus for electronically storing alphanumeric charactersUS5765156Feb 19, 1997Jun 9, 1998Microsoft CorporationData transfer with expanded clipboard formatsUS5781189May 5, 1995Jul 14, 1998Apple Computer, Inc.Embedding internet browser/buttons within components of a network component systemUS5781904 *May 1, 1997Jul 14, 1998Apple Computer, Inc.User interface system and method for traversing a databaseUS5794257Jul 14, 1995Aug 11, 1998Siemens Corporate Research, Inc.Automatic hyperlinking on multimedia by compiling link specificationsUS5799068Nov 26, 1997Aug 25, 1998Elonex I.P. Holdings Ltd.Smart phone integration with computer systemsUS5802253Feb 26, 1996Sep 1, 1998Banyan Systems IncorporatedEvent-driven rule-based messaging systemUS5802262Oct 15, 1997Sep 1, 1998Sun Microsystems, Inc.Method and apparatus for diagnosing lexical errorsUS5802299Feb 13, 1996Sep 1, 1998Microtouch Systems, Inc.Interactive system for authoring hypertext document collectionsUS5802530Jul 1, 1996Sep 1, 1998Sun Microsystems, Inc.Web document based graphical user interfaceUS5805911Feb 1, 1995Sep 8, 1998Microsoft CorporationWord prediction systemUS5809318Apr 4, 1997Sep 15, 1998Smartpatents, Inc.Method and apparatus for synchronizing, displaying and manipulating text and image documentsUS5815830Dec 18, 1995Sep 29, 1998Anthony; Andre CharlesAutomatic generation of hypertext links to multimedia topic objectsUS5818447Jun 6, 1996Oct 6, 1998Microsoft CorporationSystem and method for in-place editing of an electronic mail message using a separate programUS5821931Dec 1, 1995Oct 13, 1998Minnesota Mining And Manufacturing CompanyAttachment and control of software notesUS5822539Dec 8, 1995Oct 13, 1998Sun Microsystems, Inc.System for adding requested document cross references to a document by annotation proxy configured to merge and a directory generator and annotation serverUS5822720Jul 8, 1996Oct 13, 1998Sentius CorporationSystem amd method for linking streams of multimedia data for reference material for displayUS5826025Sep 8, 1995Oct 20, 1998Sun Microsystems, Inc.System for annotation overlay proxy configured to retrieve associated overlays associated with a document request from annotation directory created from list of overlay groupsUS5832100May 3, 1993Nov 3, 1998Trw Inc.Method and apparatus for converting documents between paper medium and electronic media using a user profileUS5845077Nov 27, 1995Dec 1, 1998Microsoft CorporationMethod and system for identifying and obtaining computer software from a remote computerUS5855007Nov 15, 1995Dec 29, 1998Jovicic; NeboisaElectronic coupon communication systemUS5859636 *Dec 27, 1995Jan 12, 1999Intel CorporationRecognition of and operation on text dataUS5872973Oct 26, 1995Feb 16, 1999Viewsoft, Inc.Method for managing dynamic relations between objects in dynamic object-oriented languagesUS5875443Jan 30, 1996Feb 23, 1999Sun Microsystems, Inc.Internet-based spelling checker dictionary system with automatic updatingUS5877757May 23, 1997Mar 2, 1999International Business Machines CorporationMethod and system for providing user help information in network applicationsUS5884266Apr 2, 1997Mar 16, 1999Motorola, Inc.Audio interface for document based information resource navigation and method thereforUS5892919Jun 23, 1997Apr 6, 1999Sun Microsystems, Inc.Spell checking universal resource locator (URL) by comparing the URL against a cache containing entries relating incorrect URLs submitted by users to corresponding correct URLsUS5893073Feb 27, 1995Apr 6, 1999Sun Microsystems, Inc.Method and apparatus for representing recurring eventsUS5893132Dec 14, 1995Apr 6, 1999Motorola, Inc.Method and system for encoding a book for reading using an electronic bookUS5895461Oct 9, 1996Apr 20, 1999Telaric, Inc.Method and system for automated data storage and retrieval with uniform addressing schemeUS5896321Nov 14, 1997Apr 20, 1999Microsoft CorporationText completion system for a miniature computerUS5900004Sep 15, 1997May 4, 1999Microsoft CorporationMethod and system for interactive formatting of word processing documents with deferred rule evaluation and format editingUS5907852Feb 1, 1996May 25, 1999Nec CorporationDocument editing apparatusUS5913214Aug 8, 1996Jun 15, 1999Massachusetts Inst TechnologyData extraction from world wide web pagesUS5920859 *Feb 5, 1997Jul 6, 1999Idd Enterprises, L.P.Hypertext document retrieval system and methodUS5924099Jun 5, 1998Jul 13, 1999Microsoft CorporationData transfer with expanded clipboard formatsUS5933139Jan 31, 1997Aug 3, 1999Microsoft CorporationMethod and apparatus for creating help functionsUS5933140Jun 30, 1997Aug 3, 1999Sun Microsystems, Inc.Child window containing context-based help and a miniaturized web pageUS5933498Nov 5, 1997Aug 3, 1999Mrj, Inc.System for controlling access and distribution of digital propertyUS5940614Apr 18, 1991Aug 17, 1999International Business Machines CorporationHypertext control method and apparatus for displaying help information in an interactive data processing systemUS5944787Apr 21, 1997Aug 31, 1999Sift, Inc.Method for automatically finding postal addresses from e-mail addressesUS5946647Feb 1, 1996Aug 31, 1999Apple Computer, Inc.System and method for performing an action on a structure in computer-generated dataUS5948061Oct 29, 1996Sep 7, 1999Double Click, Inc.Method of delivery, targeting, and measuring advertising over networksUS5956681Nov 6, 1997Sep 21, 1999Casio Computer Co., Ltd.Apparatus for generating text data on the basis of speech data input from terminalUS5974413Jul 3, 1997Oct 26, 1999Activeword Systems, Inc.Semantic user interfaceUS5987480Jul 25, 1996Nov 16, 1999Donohue; MichaelMethod and system for delivering documents customized for a particular user over the internet using imbedded dynamic contentUS5991719Sep 11, 1998Nov 23, 1999Fujistu LimitedSemantic recognition systemUS5995756Feb 14, 1997Nov 30, 1999Inprise CorporationSystem for internet-based delivery of computer applicationsUS6006265Apr 2, 1998Dec 21, 1999Hotv, Inc.Hyperlinks resolution at and by a special network server in order to enable diverse sophisticated hyperlinking upon a digital networkUS6006279Jan 21, 1997Dec 21, 1999Canon Information Systems, Inc.Plug-in module host frameworkUS6014616Nov 13, 1997Jan 11, 2000Samsung Electronics Co., Ltd.Method for monitoring the language used for character generation by an operating systemUS6018761Dec 11, 1996Jan 25, 2000The Robert G. Uomini And Louise B. Bidwell TrustSystem for adding to electronic mail messages information obtained from sources external to the electronic mail transport processUS6028605 *Feb 3, 1998Feb 22, 2000Documentum, Inc.Multi-dimensional analysis of objects by manipulating discovered semantic propertiesUS6029135Nov 14, 1995Feb 22, 2000Siemens AktiengesellschaftHypertext navigation system controlled by spoken wordsUS6029171Feb 10, 1997Feb 22, 2000Actioneer, Inc.Method and apparatus for group action processing between users of a collaboration systemUS6031525Apr 1, 1998Feb 29, 2000New York UniversityMethod and apparatus for writingUS6052531Mar 25, 1998Apr 18, 2000Symantec CorporationMulti-tiered incremental software updatingUS6061516Aug 12, 1997May 9, 2000Hitachi, Ltd.Online application processing systemUS6067087Mar 3, 1998May 23, 2000Microsoft CorporationMethod for building menus during idle timesUS6072475Aug 22, 1997Jun 6, 2000Telefonaktiebolaget Lm EricssonTouch screenUS6073090Apr 15, 1997Jun 6, 2000Silicon Graphics, Inc.System and method for independently configuring international location and languageUS6085201Jun 28, 1996Jul 4, 2000Intel CorporationContext-sensitive template engineUS6088711Jul 1, 1997Jul 11, 2000Microsoft CorporationMethod and system for defining and applying a style to a paragraphUS6092074Feb 10, 1998Jul 18, 2000Connect Innovations, Inc.Dynamic insertion and updating of hypertext links for internet serversUS6108640Jan 13, 1998Aug 22, 2000Slotznick; BenjaminSystem for calculating occasion dates and converting between different calendar systems, and intelligent agent for using sameUS6108674Jul 16, 1997Aug 22, 2000Casio Computer Co., Ltd.Image output devices which automatically selects and outputs a stored selected image in correspondence with input dataUS6112209Jun 17, 1998Aug 29, 2000Gusack; Mark DavidAssociative database model for electronic-based informational assembliesUS6121968Jun 17, 1998Sep 19, 2000Microsoft CorporationAdaptive menusUS6122647 *May 19, 1998Sep 19, 2000Perspecta, Inc.Dynamic generation of contextual links in hypertext documentsUS6311177 *Feb 16, 1999Oct 30, 2001International Business Machines CorporationAccessing databases when viewing text on the webUS6338059 *Dec 17, 1998Jan 8, 2002International Business Machines CorporationHyperlinked search interface for distributed database* Cited by examinerNon-Patent CitationsReference1"Microsoft Measurement Converter Smart Tag-Chinese Version", http://www.jiyang.gov/cn/laiying/My%20Pictures/%E8%B4%E5%BA%86%E8%BE%89/office2003/FILES/PFILES/COMMON/MSSHARED/SMARTTAG/CMEASURE/1033/CHMCABT.HTM, retrieved on Nov. 7, 2006, 2 pgs.2"UNIX Man Pages: sed," http://www.calpoly.edu/cgi-bin/man-cgi?spell+1, pp. 1-14.3"Word 2002 Add in: measurement Converter Smart Tag", http://www.microsoft.com/downloads/details.aspx?FamilyID=f67fc42c-5f41-4c3f-9d5a-71354471dc32&DisplayLang=en, retrieved on Nov. 9, 2006, 2 pgs.4(Previously cited) Koyaku, Il, "What is Brought to SQL Server 2000 by XML, Part I: Function of XML Provided by SQL Server 2000", Enterprise Servers World, vol. 3, No. 12, IDG Japan, Inc., Dec. 1, 2000, pp. 42-53 (with English language translation).5"Adding Data from Other Source in Power Point 2002,"Internet Article, The McGraw-Hill Companies, Inc., Dec. 21, 2002, http://web.archive.org/web/20021221085214/http//:www glencoe.com/ps/computered/pas/artucles.php4articleID=432.6"Altova markup your mind!" http://web.archive.org/web/20021204211721/http://altova.com/products�ide.html, Dec. 2002, pp. 1-3.7"Being �Smart� with Smart Tags in Office XP", Create for Mississippi, Aug. 2001, http://www.create.cett.msstate.edu/create/howto/smart�tags.pdf, 7 pp.8"BizTalk Server 2002 Compiling Maps", http://msdn.microsoft.com/library/en-us/bts�2002/htm/lat�xmltools�map�concept�drgl.a..., Microsoft Corporation, 1999-2001, pp. 1.9"BizTalk Server 2002 Mapper User Interface", http://msdn.microsoft.com/library/en-us/bts�2002/htm/lat�xmltools�map�concept�codw..., Microsoft Corporation, 1999-2001, pp. 1.10"BizTalk Server 2002 Testing Maps", http://msdn.microsoft.com/library/en-us/bts�2002/htm/lat�xmltools�map�concept�fhhy.a..., Microsoft Corporation, 1999-2001, pp. 1-2.11"BizTalk Server 2002 View Links and Functoids By Using Grid Preview", http://msdn.microsoft.com/library/en-us/bts�2002/htm/lat�xmltools�map�check�fuwn.as..., Microsoft Corporation, 1999-2001, pp. 1.12"How to Use XSL to Transform Excel XML Spreadsheet for Server-Side Use", http://support.microsoft.com/default.aspx?scid=kb;en-us;278976, Microsoft Corporation, Aug. 2004, pp. 1-7.13"InfoPath: Microsoft Names New Product from Office Group", http://www.microsoft.com/presspass/press/2003/feb03/02-10infopath.mspx, Microsoft Corporation, Oct. 2002-Feb. 2003, pp. 1-4.14"Integrated Development Enviorment (IDE)", http://web.archive.org/web/20020602032242/http:altova.com/products�ide.html, Jun. 2002, pp. 1-2.15"Integrating with External Systems: iPlanet� Unified Development Server", Sun Microsystems, Inc., Ver. 5.0, Aug. 2001, pp. 127-156.16"Intelligent Text Processing: About", http://www.syntalex.co.uk/about/about.html, download date: Aug. 7, 1999, 1 pp.17"Intelligent Text Processing: Automatic Cross-Referencing", http://www.syntalex.co.uk/services/acrl.html, download date Aug. 7, 1999, 3 pp.18"Intelligent Text Processing: Case Study: Context", http://www.syntalex.co.uk/casestudies/context.html, download date: Aug. 7, 1999, 3 pp.19"Microsoft BizTalk Server 2002�Using BizTalk Mapper", http://msdn.Microsoft.com/library/en-us/bts�2002/htm/lat�xmltools�map�intro�zkqb.asp..., Microsoft Corporation, 1999-2001, pp. 1-2.20"Microsoft Extends XML Web Services Support in .NET Enterprise Servers Through Visual Studio .NET", http://www.microsoft.com/presspass/press/2002/feb02/02-13servervspr.mspx, Microsoft Corporation, Feb. 2002, pp. 1-3.21"Microsoft Measurement Converter Smart Tag�Chinese Version", http://www.jiyang.gov/cn/laiying/My%20Pictures/%E8%B4%E5%BA%86%E8%BE%89/office2003/FILES/PFILES/COMMON/MSSHARED/SMARTTAG/CMEASURE/1033/CHMCABT.HTM, retrieved on Nov. 7, 2006, 2 pgs.22"Microsoft Unveils Visual Studio.NET Enterprise Tools", Microsoft Corporation, http://microsoft.com/presspass/press/2001/may01/05-21vseepr.mspx, May 2001, pp. 1-4.23"New Microsoft Office Family Application Taps Power of Industry-Standard XML", http://www.microsoft.com/presspass/press/2002/oct02/10-09officefamilypr.mspx, Microsoft Corporation, Oct. 2002-Feb. 2003, pp. 1-2.24"Q&A: How �XDocs� Alters the Paradigm for Gathering Business-Critical Information", http://www.microsoft.com/presspass/press/2002/oct02/10-09officefamily.mspx, Microsoft Corporation, Oct. 2002-Feb. 2003, pp. 1-4.25"Smart Tags: Dumb Technology?", webreference.com, Online, Aug. 29, 2001, http://www.webreference.com/xml/column30/3.html, 3 pp.26"The Spatial Smart Tag", Geomatic Technologies, Mar. 10, 2005, 2 pp.27"The StarOffice� 6.0 Suite: New Features Guide", Sun Microsystems, V. 1.1, Jul. 2002, pp. 1-31.28"Using Flyswat", http://www.flywsat.com/using.html, download date: Sep. 28, 1999, 1 pp.29"What is Flyswat", http://www.flyswat.com, download date: Sep. 28, 1999, 5 pp.30"XML Schema Part 2: Datatypes," W3C, May 2, 2001, http://www.w3.org/TR/2001/REC-xmlschema-2-20010502/, pp. 1-146 (separated into 2 documents�A & B).31A. Bonifati, "Active Behaviors within XML Document Management", EDBT Ph. D. Workshop, Mar. 2000, pp. 1-4.32An XML framework for agent-based E-commerce; Robert J. Glushko, Jay M. Tenenbaum and Bart Meltzer; Commun. ACM 42, 3 (Mar. 1999) p. 106.33Anonymous, "Adding Data from Other Sources in PowerPoint 2002," Jul. 2002, Internet article, XP-002420700, A Professional Approach Series the E-Zine Approach, http://www.glencoe.com/ps/computered/pas/article.php4?articleId-437, 8 pgs.34Anonymous, "Moving and Copying Text Tutorial," Aug. 17, 2001, Internet Article, XP-002307566, http://tutorials.findtutorials.com/read/category/102/id/342/p/3, 4 pgs.35Apple Data Detectors User's Manual, Apple Computer, Inc., 1997, pp. 1-15.36Arbortext, "Arbortext and Accessibilty", http://web.archive.org/web/20021219133536/www.arbortext.com/html/accessibility.html, Dec. 2002, pp. 1-5.37Arbortext, "Arbortext's Support for XSL-FO", http://web.archive.org/web/20021221021632/www.arbortext.com/html/xsl-fo.html. Dec. 2002, pp. 1-4.38Arbortext, "Schemas", http://web.archive.org/web/20021221023148/www.arbortext.com/html/schemas.html, Dec. 2002, pp. 1-3.39Arbortext, "XML Compliance, 100% Pure XML", http:web.archive.org/web/20021209185855/www.arbortext.com/html/xml�compliance, Dec. 2002, pp. 1-3.40Australian First Examiner's Report dated Sep. 15, 2008 cited in Australian Appl. No. 2003204379 (60001.0181AU01).41Australian First Official Action dated Oct. 21, 2008 cited in Application No. 2003204800.42Australian First Official Action Report dated Jan. 18, 2009 cited in Application No. 2004200459.43Australian Second Official Action dated Sep. 11, 2009 cited in Application No. 2003204478.44Australian Third Official Action dated Dec. 23, 2009 cited in Application No. 2003204478.45Beitner, N.D.; Hall, W.; Goble, C.A., "Multimedia Support and Authoring in Microcosm: An Extended Model," Dept. of Electronics and Computer Science, Univ. of Southampton, Southampton SO17 1BJ, UK; Dept. of Computer Science, Univ. of Manchester, Oxford Road, Manchester MI3 9PL, UK, pp. 1-12.46Blaheta et al., "Assigning Function Tags to Parsed Text," Morgan Kaufmann Publishers Inc., 2000, pp. 234-240.47Boone, "Concept Features in Re: Agent, An Intelligent Email Agent", Proceedings of the 2nd International Conference on Autonomous Agents, May 9-13, 1998, pp. 141-148.48Bosak, "XML: The Universal Publishing Format", SGML/XML Europe '98, May 1998, pp. A1-C17.49Brockschmidt, K., "Inside OLE, Second Edition", 1995, Microsoft Press, p. 169.50Brooks-Bilson, "Programming ColdFusion" [electronic resource] 2001, Safari Tech Books Online, 1st Edition, 25 pp.51C. Goldfarb, XML Handbook, 1st Ed., Pearson Education, Japan, May 10, 1999, pp. 246-254 (no English translation).52C. Heinemann, "Cross-Reference your XML Data", Microsoft Corporation, Dec. 7, 1998, 6 pgs.53Camarda, B., Special Editing Using� Microsoft� Office Word 2003, Que, Dec. 12, 2003, pp. 1-5.54Chilean Second Office Action cited in Chilean Application No. 67-2005.55Chinese Decision on Rejection dated Jul. 3, 2009 cited in Application No. 03143003.1.56Chinese Final Rejection dated Mar. 13, 2009 cited in Application No. 03145242.6.57Chinese Office Action dated Oct. 17, 2008 cited in Application No. 03145242.6.58Chinese Official Action dated Dec. 28, 2007 cited in Application No. 200410005390.8.59Chinese Official Action dated Dec. 7, 2007 in Chinese Application No. 200510088529.4.60Chinese Official Action dated Jan. 4, 2008 cited in Application No. 200510009487.0.61Chinese Second Official Action dated Aug. 15, 2008 in Chinese Application No. 200510088529.4.62Claris Em@iler Getting Started User's Guide, For Macintosh, Claris Corporation, 1995-1997.63Clark, James, and DeRose, Steve, "XML Path Language (XPath), Version 1.0", W3C, http://web.archive.org/web/2021010034434/http://www.w3.org/TR/xpath, 1999-2000, pp. 1-31.64CLUES: dynamic personalized message filtering; Matthew Marx and Chris Schmandt; Proceedings of the ACM 1996 conference on computer supported cooperative work (1996) p. 113-121.65Command management system for next-generation user input; M. Tsai, P. Reiher and G.J. Popek; Proceedings of the seventh workshop on hottopics in operating systems, (1999) p. 17984.66Constructing, organizing, and visualizing collections of tropically related Web resources; Loren Terveen, Will Hill and Brian Amento; ACM Trans. Comput.-um. Interact. 6, 1 (Mar. 1999) p. 67-94.67Corel, "Corel XMetal 4 and Interwoven TeamXML", http://web.archive.org/web/20030807211225/www.corel.com/futuretense�cs/ccurl/corel+xml+4+and+interwoven+teamxml.pdf, Aug. 2003, pp. 1-2.68Corel, "Corel XMetal4, Making XML Content Creation Easy", http://web.archive.org/web/20031118215158/www.corel.com/servlet/Satellite?pagename, Nov. 2003, pp. 1-2.69Corel, "The Corel-XyEnterprise XML Solution", http://web.archive.org/web/20030807154355/www.corel.com/futuretense�cs/ccurl/corel+and+XY+enterprise+XML+solution.pdf, Aug. 2003, pp. 1-2.70Corel� Office Professional 7 Quick Results User's Manual, vol. 1, Version 7.0 (first printing), Corel Corporation, Limited, pp. 1-531.71Cornell, Paul, "Developing Smart Tag DLLs", MSDN Library, http://msdn.microsoft.com/library/default.asp?url=/library/en-us/dnsmarttag/html/odc�smarttags.asp, Apr. 2001, pp. 8.72D. Obasanjo, "XML�Namespaces and How They Affect Xpath and XSLT", Microsoft Corporation, May 20, 2002, 19 pgs.73D. Richter, "Windows for professionals" (Win32 API programming for Windows NT 3.5 and Windows 95, translation from English, Moscow: Russian Edition, 1995, ISBN 5-7502-0010-8, pp. 26, 31, 215.74David D. Lewis et al., "A Sequential Algorithm for Training Text Classifiers," Spring-Verlag New York, Inc., 1994, pp. 1-10.75Design methodology and formal validation of hypermedia documents; C.A.S. Santos, L.F.G Soares, G.L. de Souza and J.P. Courtiat; Proceedings of the sixth ACM international conference on multimedia, (1998) p. 39-48.76Devanbue, P. et al., "Chime: customizable hyperlink insertion and maintenance engine for software engineering environments", Software Engineering, Publication date: 1999, ISBN: 1-58113-07400.77Developer's Guide To Apple Data Detectors, For Version 1.0.2., Apple Computer, Inc., 1997, pp. 1-33.78Driza, Scott, "Learn Word 2000 VBA Document Automation", Wordware Publishing Inc., 2001, 6 pp.79Dynamic hyperlink generation for navigation in relational databases; Karl M. Goschka and Jurgen Falb; Proceedings of the tenth ACM conference on hypertext and hypermedia: returning to our diverse roots (1999) p. 23-24.80European Communication dated Dec. 11, 2006 in EP 03 012 830.0-2211.81European Communication dated Feb. 16, 2007 cited in European Application No. 04 003 683.2-2211.82European Communication dated Jun. 3, 2008 cited in European Application No. 03 011 851.7-2211.83European Communication dated Mar. 18, 2009 cited in European Appl. No. 04003683.Feb. 2211 (60001.0216EPOI).84European Communication dated Nov. 17, 2006 in EP 03 011 851.7-2211.85European Communication dated Nov. 9, 2006 in EP 03010292.5.86European Communication dated Sep. 25, 2006 in EP 03 01 4181.87European Communication dated Sep. 25, 2007 cited in European Application No. 03 014 181.6�1243.88European Communication Minutes of Oral Proceedings and Decision dated Sep. 15, 2008 in European Application No. 05 000 506.5-1527.89European Communication Summons to Attend Oral Proceedings dated Mar. 10, 2008 in EP 03 01 0292.5-1527.90European Communication Summons to Attend Oral Proceedings dated Mar. 4, 2008 in EP 05 000 506.5-1527.91European Communication Summons to Attend Oral Proceedings dated May 7, 2008 cited in European Application No. 04002224.6.92European Examination Report dated Mar. 4, 2006 cited in EP Application No. 02 014 717.9-1527.93European Examination Report dated Mar. 4, 2006 cited in EP Application No. 03 012 432.5-1527.94European Examination Report dated Oct. 9, 2007 in European Application No. 05 105 000.3-1527.95European Patent Office Communication dated Apr. 19, 2006 in Application No. 05 000 506.5-1527.96European Patent Office Communication dated Apr. 19, 2006 in Application No. 05 000 506.5�1527.97European Preliminary Opinion dated Aug. 27, 2008 cited in European Application No. 04002224.6�1527 / 1447754.98European Search Report dated Dec. 12, 2006 in European Application No. 05 105 000.3-1527.99European Statement regarding Grounds of Appeal dated Jan. 13, 2009 cited in Application No. 04 002 224.6.100European Summons to Attend Oral Proceedings dated Aug. 5, 2009 cited in Application No. 03003931.7.101European Summons to Attend Oral Proceedings dated Feb. 26, 2009 cited in European Appl. No. 0301283.0/2211 (60001.0182EP01).102European Summons to Attend Oral Proceedings dated Mar. 20, 2009 cited in European Appl. No. 03012830.0 (60001.0182EP01).103Exploring the applications user-expertise assessment for intelligent interfaces; Michel C. Desmarais and Jiming Liu; Proceedings of the conference on human factors in computing systems, (1993) p. 308-313.104Fan et al., "FormPlus: A Form Authoring Toolkit", Proceedings of the Fourteenth Annual Computer Software and Applications Conference, Oct. 31, 1990-Nov. 2, 1990, pp. 255-260.105Flanagan, D., "JavaScript�The Definitive Guide, Fourth Edition", Jan. 2002, O'Reilly, 12 pp.106Frye, C., Microsoft Office Systems: Step by Step, Microsoft Press, 2003 Edition, Sep. 3, 2003, pp. 1-6.107Future directions in user-computer interface software; James D. Foley; Conference proceedings on organizational computer systems, (1991) p. 289-297.108G. Falquet et al., "Design and Analysis of Active Hypertext Views on Databases", Information Sciences Institute, Jan. 2002, pp. 1-24.109Getting Results With Microsoft� Office 97, Real World Solutions For The Work You Do, Microsoft Corporation, pp. 1-703.110Ghamrawi et al., "Collective Multi-Label Classification," ACM, 2005, pp. 195-200.111Glover et al., "Inferring hierarchical Descriptions," ACM, 2002, pp. 507-514.112Hara, T. et al.,Inside Microsoft.NET-Complete Explanation, "What Microsoft Aims for", msdn magazine, No. 6, pp. 20-35, ASCII, Japan, Sep. 18, 2000, 19 pages.113Harmon, D., "Microsoft MapPoint 2002", Geoworld Quick-Take Reviews, Aug. 2001, 3 pp.114Harold, E.R., "XML: Extensible Markup Language", IDG Books Worldwide, Books 24�7.com printout, 1998, pp. 1-11.115Hewkin, "Smart Tags�the Distributed-Memory Resolution", IEE Review, Jun. 22, 1989, pp. 203-206.116Homer, Alex et al., Professional Active Services Pages, 1997, Wrox Press Ltd., Section"Client-Side Scripting and Components", subsection "Choosing Your Applets, and Controls", 16 pp.117How to personalize the Web; Rob Barrett, Paul P. Maglio and Daniel C. Kellem; Conference proceedings on human factors in computing systems (1997) p. 75-82.118Human-computer interface development: concepts and systems for its management H. Rex Hartson and Deborah Hix; ACM Comput. Surv. 1 (Mar. 1989) p. 5-92.119IBM Corporation, IBM Research Disclosure #368; "Multimedia Hyperlinks Automatically Created For Reference Documents," IBM Technical Disclosure Bulletin, Jun. 1993, pp. 1-5.120IBM Technical Disclosure Bulletin, "National Language Support Enhancement for Culture-Specific Operations", Nov. 1, 1993, vol. 36, Issue 11, pp. 629-638.121InfoCentral(TM) 7, User's Manual, Corel Corporation, vol. 1, Version 7.0, 1996, pp. 1-86.122InfoCentral� 7, User's Manual, Corel Corporation, vol. 1, Version 7.0, 1996, pp. 1-86.123Integrating computer technology, people technology; strategies and case studies from Georgia Tech's Graphics, Visualization and Usability Center, Jim Foley; Proceedings of the workshop on advanced visual interfaces, (1994) p. 34-43.124Interface and execution models in the fluke kernel; Bryan Ford, Mike Hibler, Jay Lepreau, Roland McGrath and Patrick Tullman; Proceedings of the third symposium on operating systems design and implementation, (1999) p. 101-115.125Irie R. et al., "Resources for Place Name Analysis", May 28, 2004, 4 pp.126Ivens, K., Office XP Smart Tags, Microsoft, Mar. 6, 2002, pp. 1-4.127Japanese Final Official Action dated Nov. 25, 2008 cited in Japanese Appl. No. 2002-207514 (60001.0079JP11).128Japanese Final Rejection dated Apr. 3, 2009 cited in Application No. 2002-207514.129Japanese Final Rejection dated Mar. 17, 2090 cited in Application No. 2004-037158.130Japanese Office Action dated Jul. 18, 2008 cited in Japanese Application No. 2002-207514.131Japanese Office Action dated Oct. 10, 2008 cited in Application No. 2004-037158.132Japanese Official Action dated Apr. 18, 2008 cited in Japanese Application No. 2003-128417.133Japanese Official Action dated Feb. 13, 2009 cited in Japanese Appl. No. 2003-162911 (60001.018 1JP01).134Japanese Official Action dated Feb. 24, 2009 cited in Japanese Appl.No. 2003-161338 (60001.0182JP01).135Japanese Official Action dated Feb. 6, 2009 cited in Japanese Appl. No. 2003-180218 (60001.0190JP01).136Japanese Official Action dated Mar. 28, 2008 cited in Japanese Application No. 2003-178497.137Japanese Official Action dated Mar. 6, 2009 cited in Japanese Appl. No. 2004-042140 (60001.0216JP01).138Japanese Official Action dated May 26, 2009 cited in Appl. No. 2005-039754.139Japanese Official Action dated Oct. 19, 2007 cited in Japanese Application No. 2003-128417.140Japanese Official Notice of Final Rejection dated Oct. 2, 2009 cited in Application No. 2003-162911.141Japanese Official Notice of Final Rejection dated Oct. 27, 2009 cited in Application No. 2003-161338.142Johnson, L., "What's So Special About Paste Special?", Jun. 2002, Internet article, XP-002420702, http://pubs.logicalexpressions.com/Pub0009/LPMArticle.asp?ID=40, 5 pgs.143Korean Official Action dated Sep. 30, 2009 cited in Application No. 10-2003-40988.144Koyaku, H., "What is Brought to SQL Server 2000 by XML, Part 1: Function of XML Provided by SQL Server 2000", Enterprise Servers World, vol. 3, No. 12, IDG Japan, Inc., Dec. 1, 2000, pp. 42-53.145Kristensen, "Template Resolution in XML/HTML", Computer Networks and ISDN Systems, vol. 30, 1998, pp. 239-249.146Kuenning, Geoff, "International Ispell," Version 3.1.00, Oct. 8, 1993, http:// www.rt.com/man/findaffix.1.html, http://www.csee.usf.edu/cgi-bin/man-cig?ispell, http://fmg-www.cs.ucla.edu/geoff/ispell.html, pp. 1-33.147Kuenning, Geoff, "Ispell, v. 3.1," http://theochem.ki.ku.dk/on-line-docs/ispell/ispell-1.html, pp. 1-6.148Kuenning, Geoff, "Ispell, v. 3.1," http://theochem.ki.ku.dk/on�line�docs/ispell/ispell�1.html, pp. 1-6.149M. Fernandez et al., "SilkRoute: trading between relations and XML", Computer Networks, vol. 33, No. 1-6, Jun. 2000, pp. 723-745.150M. Stowe, "XML in Excel and the Spreadsheet Component", Microsoft Corporation, Aug. 2001, 6 pgs.151Malaysian Examination Report dated Nov. 30, 2009 cited in Application No. PI 20040559.152Malaysian Official Action dated Aug. 29, 2008 cited in Malaysian Application No. PI 20031902.153Malaysian Search Report dated Aug. 2, 2007 cited in Malaysian Application No. PI 20040265.154Marais, Hannes, "Supporting Cooperative and Personal Surfing With a Desktop Assistant", 1997, ACM Press, pp. 129-138.155McMahon, Lee. E., "SED-A Non-Interactive Text Editor," Bell Laboratories, Murray Hill, New Jersey 07974, pp. 1-15.156McMahon, Lee. E., "SED�A Non-Interactive Text Editor," Bell Laboratories, Murray Hill, New Jersey 07974, pp. 1-15.157Measuring Units Conversion Table�http://web.archie.org�1997 Internet French Property, pp. 1-4.158Menu Customizing, IBM Technical Disclosure Bulletin, vol. 34, No. 1, Jun. 1991, pp. 91-92 (4 pp. total).159Mexican Official Action dated Feb. 11, 2009 cited in Application No. PA/a/2003/005451.160 *Microsoft, Microsoft Computer Dictionary, Microsoft Press, Fifth Edition, p. 409, 2002.161Mueller, Jennifer M., "Work Smarter with Smart Tags", Journal of Accounting�Online, vol. 194, No. 5, Nov. 2002, http://www.aicpa.org/pubs/jofa/nov2002/Mueller.htm>, retrieved on Apr. 22, 2005.162Nardi, Bonnie A.; Miller, James R.; Wright, David J., "Collaborative, Programmable Intelligent Agents," Jim Miller/Miramontes Computing, Apple Computer Advanced Technology Group, Mar. 1998, pp. 1-11.163Norwegian Official Action dated Aug. 24, 2009 cited in Application No. 2003 2550.164Novell GroupWise User's Guide for Windows 16-Bit Version 5.2, Novell, Inc., 1993-1997, pp. 1-231.165Novell GroupWise User's Guide for Windows 32-Bit Version 5.2, Novell, Inc., 1998, pp. 1-318.166Percepual user interfaces: perceptual intelligence; Alex Pentland; Commun. ACM 43, 3 (Mar. 2000) p. 35-44.167Perry, Brad, et al., "Discovering Similar Resources by Content Park-Linking", Proceedings of the Sixth International Conference on Information and Knowledge Management, published by ACM Press 1997, pp. 317-324.168Pershikov, V.I., "Explanatory Dictionary in Informatics," Finances and Statistics, Moscow, 1991 (in Russian with translated sections) 5 pgs.169Pixley, "Document Object Model (DOM) Level 2 Events Specification Version 1.0", World Wide Web Consortium, Nov. 13, 2000, www.w3.org/TR/2000/REC-DOM-Level-2-Events-20001113/DOM2-Events.pdf.170Polish Official Action dated Aug. 25, 2009 cited in Application No. P. 365553.171Polish Official Action dated Aug. 27, 2008 in Polish Application No. P360520.172Polish Official Action dated Jul. 21, 2008 cited in Polish Application No. P 364854.173Polish Official Letter dated Jun. 24, 2008 cited Polish Application No. P 365553.174Polish Official Notice dated Sep. 22, 2009 cited in Application No. P. 364854/DP.175Polish Official Notice dated Sep. 23, 2009 cited in Application No. P. 360520/DP.176Polish Second Official Action dated Oct. 28, 2008 in Polish Application No. P36553.177Putting People First: Specifying Proper Names in Speech Interfaces, Matt Marx and Chris Schmandt; Proceedings of the ACM Symposium on User Interface Software and Technology; 1994; pp. 29-37.178Quin, Liam, "Extensible Markup Language (XML)", W3C Architecture Domain, http://web.archive.org/web/2002121962057/http://www.w3.org/XML/, 1996-2002, pp. 1-3.179Rajabifard, A. et al., "Creating an Enabling Platform for the Delivery of Spatial Information", Spatial Sciences Institute Biennial Conference, Sep. 12, 2005, 10 pp.180Rice, F.C., "Transform XML Files with XSLT When Importing into Microsoft Excel 2002," Jul. 2001, Internet article, XP-002420701, http://msdn2.microsoft.com/en-us/library/aa140055(office,10,d=printer).aspx, 9 pgs.181Rubin, C., "Microsoft Word 2000 Official Manual", First Edition, Nikkei BP Soft Press, Inc., Aug. 2, 1999, pp. 215-217.182Rubin, Charles, "Microsoft Word 2000 Official Manual," First Edition, Nikkei BP Soft Press, Inc., Aug. 2, 1999, pp. 215-217.183Russian Official Action dated Jan. 11, 2008 cited in Russian Application No. 2004105880/09(006292).184Russian Official Action dated Jun. 21, 2009 cited in Application No. 2005104223/09(005505).185Russian Official Action dated Mar. 13, 2008 cited in Russian Application No. 2004104096/09(004398).186Russian Official Action dated Oct. 11, 2008 cited in Russian Application No. 2003118722.187S. Ceri et al., "Deriving Production Rules for Incremental View Maintenance", Proceedings of the 17th International Conference on Very Large Data Bases, Sep. 1991, pp. 577-589.188S. Tanaka, "Verifying the XML Schema Definition," XML Magazine, Shoeisha Co., Ltd., vol. 10, No. 3, Jul. 1, 2000, pp. 135-155 (no English translation).189Schulz, Charles, "Writing Applications for Uniform Operation on a Mainframe or PC: A Metric Conversion Program", Lockheed Missles & Space Company, Inc., Sunnyvale, CA, May 1990, pp. 348-361.190Sharon Oviatt et al., "Integration and Synchronization of Input Modes during Multimodal Human-Computer Interaction," CHI 97, Atlanta, Georgia, Mar. 22-27, 1997, pp. 415-422.191Shiroiwa, K., "iMac&iBook, Must-see for User, Full of Recommended Setting Methods and Specially Selected Tips, Mastering Mac 0S9", MacPeople, ASCII Corporation, Japan, Dec. 3, 1999, vol. 5, No. 24, p. 50 (in Japanese - no translation yet).192Singapore Examination Reported (conducted by Austrian Patent Office) dated Jan. 25, 2008 cited in SG Application No. 200500214-2.193Singapore Search Report/Written Opinion dated Jan. 26, 2007 in SG 200500214-2.194Sperberg-McQueen, C.M. and Thompson, Henry, "XML Schema", W3C Architecture Domain, http://web.archive.org/web/20020802155904/http://www.w3.org/XML/Schema, 2000-2002, pp. 1-10.195Sriram, V., "ComponentXchange: An E-Exchange for Software Components", Master Thesis, CitSeer, May 2001, pp. i-v, 1-77.196Takkinen et al., "CAF�: A Conceptual Model for Managing Information in Electronic Mail", Proceedings of the Annual Hawaii International Conference on System Sciences, 1998, pp. 44-53.197Technique for Automatically Correcting Words in Text; Karen Kukich;ACM Comput. Surv., 24, 4 (Dec. 1992); pp. 377-439.198Textual context analysis for information retrieval; Mark A. Stairmand; Proceedings of the 20th annual international ACM SIGIR conference on research and development in information retrieval (1997) p. 140-147.199The Complete LINUX(TM) Operating System 5.2 Deluxe, Red Hat,� Macmillian Digital Publishing USA, A Viacom Company, Red Hat Software, Inc., ISBN 1-57595-199-1B, pp. 1-385.200The Complete LINUX� Operating System 5.2 Deluxe, Red Hat,� Macmillian Digital Publishing USA, A Viacom Company, Red Hat Software, Inc., ISBN 1-57595-199-1B, pp. 1-385.201Toth, V., "Visual C++ 4 Unleashed", 1996, Sams Publishing, p. 174.202Towers, J. Tarin, Visual Quickstart Guide: Dreamweaver 2 for Windows and Macintosh, 1999, Peachpit Press, pp. 150-151.203U.S. Appl. No. 09/588,411, filed Jun. 6, 2000, entitled "Method and System for Semantically Labeling Strings and Providing Actions Based on Semantically Labeled Strings."204U.S. Appl. No. 09/818,157, filed Mar. 27, 2001, entitled "Automatically Adding Proper Names to a Database."205U.S. Appl. No. 09/841,265, filed Apr. 24, 2001, entitled "Method and System for Applying Input Mode Bias."206U.S. Appl. No. 09/841,266, filed Apr. 24, 2001, entitled "Method and System for Providing Electronic Commerce Actions Based on Semantically Labeled Strings."207U.S. Appl. No. 09/906,467, filed Jul. 16, 2001, entitled "Application Program Interfaces for Semantically Labeling Strings and Providing Actions Based on Semantically Labeled Strings."208U.S. Appl. No. 09/907,418, filed Jul. 17, 2001, entitled "Method and System for Defining Semantic Categories and Actions."209U.S. Appl. No. 10/140,544, filed May 7, 2002, entitled "Method, System, and Apparatus for Converting Numbers Between Measurement Systems Based Upon Semantically Labeled Strings."210U.S. Appl. No. 10/141,712, filed May 9, 2002, entitled "Method, System, and Apparatus for Converting Dates Between Calendars and Languages Based Upon Semantically Labeled Strings."211U.S. Appl. No. 10/154,630, filed May 23, 2002, entitled "Method, System, and Apparatus for Converting Numbers Based Upon Semantically Labeled Strings."212U.S. Appl. No. 10/155,680, filed May 23, 2002, entitled "Method, System, and Apparatus for Converting Currency Values Based Upon Semantically Labeled Strings."213U.S. Appl. No. 10/164,260, filed Jun. 5, 2002, entitled "Mechanism for Downloading Software Components from a Remote Source for Use by a Local Software Application".214U.S. Appl. No. 10/164,960, filed Jun. 6, 2002, entitled "Providing Contextually Sensitive Actions and Help Content in Computer-Generated Documents".215U.S. Appl. No. 10/178,680, filed Jun. 24, 2002, entitled "System and Method for Incorporating Smart Tags in Online Content."216U.S. Appl. No. 10/179,438, filed Jun. 25, 2002, entitled "Method and System for Dynamically Providing Actions Associated with Semantically Labeled Strings."217U.S. Appl. No. 10/179,810, filed Jun. 25, 2002, entitled "Method, System, and Apparatus for Performing Custom Actions on Digital Content."218U.S. Appl. No. 10/183,317, filed Jun. 25, 2002, entitled "System and Method for Issuing a Message to a Program".219U.S. Appl. No. 10/184,190, filed Jun. 27, 2002, entitled "System and Method for Providing Namespace Related Information".220U.S. Appl. No. 10/184,298, filed Jun. 27, 2002, entitled "Method and System for Associating Actions with Semantic Labels in Electronic Documents."221U.S. Appl. No. 10/366,141, filed Feb. 13, 2003, entitled "Linking Elements of a Document to Corresponding Fields, Queries and/or Procedures in a Database".222U.S. Appl. No. 10/377,258, filed Feb. 28, 2003, entitled "Method and System for Enhancing Paste Functionality of a Computer Software Application".223U.S. Appl. No. 10/426,446, filed Apr. 29, 2003, Feinberg et al.224U.S. Appl. No. 10/608,267, filed Jun. 27, 2003, entitled "Leveraging Markup Language Data for Semantically Labeling Text Strings and Data and for Providing Actions Based on Semantically Labeled Text Strings and Data".225U.S. Appl. No. 10/731,899, filed Dec. 9, 2003, entitled "Mechanism for Downloading Components Associated with XML Documents and Smart Documents".226U.S. Appl. No. 10/780,376, filed Feb. 17, 2004, entitled "Methods and Systems for Providing Automatic Actions on Recognized Text Strings in a Computer-Generated Document".227U.S. Appl. No. 11/396,937, filed Apr. 3, 2006, entitled "Automatically Adding Proper Names to a Database".228U.S. Appl. No. 11/924,856, filed Oct. 26, 2007 entitled "Providing Contextually Sensitive Tools and Help Content in Computer-Generated Documents".229U.S. Examiner's Answer BPAI dated Jun. 5, 2008 cited in U.S. Appl. No. 10/184,298.230U.S. Final Office Action dated Dec. 18, 2007 cited in U.S. Appl. No. 10/366,141.231U.S. Final Office Action dated Dec. 24, 2008 cited in Appl. No. 09/841,265.232U.S. Final Office Action dated Dec. 26, 2007 cited in U.S. Appl. No. 09/841,265.233U.S. Final Office Action dated Dec. 7, 2007 cited in U.S. Appl. No. 10/426,446.234U.S. Final Office Action dated Dec. 8, 2008 cited in Appl. No. 10/183,317.235U.S. Final Office Action dated Feb. 20, 2008 cited in U.S. Appl. No. 10/154,630.236U.S. Final Office Action dated Jan. 22, 2009 cited in Appl. No. 10/366,141.237U.S. Final Office Action dated Jan. 7, 2008 cited in U.S. Appl. No. 10/179,438.238U.S. Final Office Action dated Jan. 9, 2008 cited in U.S. Appl. No. 09/906,467.239U.S. Final Office Action dated Jul. 12, 2007 cited in U.S. Appl. No. 10/184,298.240U.S. Final Office Action dated Jul. 26, 2007 cited in U.S. Appl. No. 10/164,960.241U.S. Final Office Action dated Jul. 29, 2008 cited in U.S. Appl. No. 10/141,712.242U.S. Final Office Action dated Jun. 27, 2008 cited in U.S. Appl. No. 10/377,258.243U.S. Final Office Action dated Mar. 4, 2009 cited in Appl. No. 10/780,376.244U.S. Final Office Action dated Nov. 30, 2009 cited in Appl. No. 10/179,810.245U.S. Final Office Action dated Oct. 16, 2007 cited in U.S. Appl. No. 09/907,418.246U.S. Final Office Action dated Oct. 19, 2007 cited in U.S. Appl. No. 09/588,411.247U.S. Final Office Action dated Oct. 19, 2007 cited in U.S. Appl. No. 10/141,712.248U.S. Final Office Action dated Oct. 19, 2007 cited in U.S. Appl. No. 10/184,190.249U.S. Final Official Action dated Apr. 17, 2006 in U.S. Appl. No. 10/184,190.250U.S. Final Official Action dated Aug. 18, 2006 cited in U.S. Appl. No. 09/907,418.251U.S. Final Official Action dated Jun. 15, 2007 cited in U.S. Appl. No. 10/731,899.252U.S. Final Official Action dated May 18, 2007 cited in U.S. Appl. No. 10/155,680.253U.S. Final Official Action dated Oct. 19, 2006 cited in U.S. Appl. No. 09/906,467.254U.S. Final Official Action dated Oct. 5, 2006 cited in U.S. Appl. No. 09/841,266.255U.S. Final Official Action mailed Apr. 29, 2008 cited in U.S. Appl. No. 10/179,810.256U.S. Office Action dated Apr. 20, 2009 cited in Appl. No. 10/426,446.257U.S. Office Action dated Apr. 27, 2009 cited in Appl. No. 10/154,630.258U.S. Office Action dated Aug. 1, 2008 cited in U.S. Appl. No. 10/366,141.259U.S. Office Action dated Aug. 10, 2007 cited in U.S. Appl. No. 10/179,810.260U.S. Office Action dated Dec. 20, 2006, U.S. Appl. No. 10/154,630.261U.S. Office Action dated Dec. 23, 2008 cited in Appl. No. 10/179,810.262U.S. Office Action dated Dec. 26, 2006, U.S. Appl. No. 10/179,810.263U.S. Office Action dated Dec. 26, 2007 cited in U.S. Appl. No. 10/377,258.264U.S. Office Action dated Feb. 15, 2008 cited in U.S. Appl. No. 10/731,899.265U.S. Office Action dated Feb. 4, 2009 cited in Appl. No. 10/377,258.266U.S. Office Action dated Feb. 8, 2008 cited in U.S. Appl. No. 10/141,712.267U.S. Office Action dated Jan. 25, 2008 cited in U.S. Appl. No. 10/608,267.268U.S. Office Action dated Jan. 5, 2007, U.S. Appl. No. 10/183,317.269U.S. Office Action dated Jan. 5, 2009 cited in Appl. No. 10/141,712.270U.S. Office Action dated Jul. 13, 2007 cited in U.S. Appl. No. 10/134,630.271U.S. Office Action dated Jul. 20, 2007 cited in U.S. Appl. No. 09/841,265.272U.S. Office Action dated Jun. 11, 2008 cited in U.S. Appl. No. 09/841,265.273U.S. Office Action dated Jun. 12, 2008 cited in U.S. Appl. No. 10/426,446.274U.S. Office Action dated Jun. 13, 2008 cited in U.S. Appl. No. 10/780,376.275U.S. Office Action dated Jun. 28, 2007 cited in U.S. Appl. No. 09/841,266.276U.S. Office Action dated Nov. 15, 2006 cited in U.S. Appl. No. 10/179,438.277U.S. Office Action dated Nov. 9, 2006 cited in U.S. Appl. No. 10/184,298.278U.S. Office Action dated Oct. 17, 2007 cited in U.S. Appl. No. 10/155,680.279U.S. Office Action dated Oct. 22, 2009 cited in Appl. No. 10/377,258.280U.S. Office Action dated Oct. 9, 2007 cited in U.S. Appl. No. 10/183,317.281U.S. Office Action dated Sep. 10, 2007 cited in U.S. Appl. No. 10/179,438.282U.S. Office Action dated Sep. 27, 2007 cited in U.S. Appl. No. 10/608,267.283U.S. Official Action dated Apr. 10, 2006 in U.S. Appl. No. 10/179,810.284U.S. Official Action dated Apr. 10, 2007 cited in U.S. Appl. No. 09/907,418.285U.S. Official Action dated Apr. 17, 2006 in U.S. Appl. No. 10/179,438.286U.S. Official Action dated Apr. 19, 2005 in U.S. Appl. No. 09/841,266.287U.S. Official Action dated Apr. 5, 2006 in U.S. Appl. No. 10/377,258.288U.S. Official Action dated Apr. 8, 2005 in U.S. Appl. No. 10/164,960.289U.S. Official Action dated Aug. 2, 2006 in U.S. Appl. No. 10/731,899.290U.S. Official Action dated Aug. 20, 2004 in U.S. Appl. No. 09/841,266.291U.S. Official Action dated Aug. 9, 2006 cited in U.S. Appl. No. 10/164,960.292U.S. Official Action dated Dec. 14, 2005 in U.S. Appl. No. 10/608,267.293U.S. Official Action dated Dec. 15, 2005 in U.S. Appl. No. 10/155,680.294U.S. Official Action dated Dec. 29, 2003 in U.S. Appl. No. 09/588,411.295U.S. Official Action dated Dec. 5, 2005 in U.S. Appl. No. 09/907,418.296U.S. Official Action dated Dec. 8, 2004 in U.S. Appl. No. 09/588,411.297U.S. Official Action dated Feb. 12, 2004 in U.S. Appl. No. 10/154,630.298U.S. Official Action dated Feb. 16, 2006 in U.S. Appl. No. 10/184,298.299U.S. Official Action dated Feb. 2, 2006 in U.S. Appl. No. 09/906,467.300U.S. Official Action dated Feb. 21, 2007 cited in U.S. Appl. No. 10/366,141.301U.S. Official Action dated Feb. 24, 2006 in U.S. Appl. No. 10/154,630.302U.S. Official Action dated Feb. 6, 2007 cited in U.S. Appl. No. 09/588,411.303U.S. Official Action dated Feb. 7, 2007 cited in U.S. Appl. No. 10/179,438.304U.S. Official Action dated Jan. 11, 2006 in U.S. Appl. No. 09/841,266.305U.S. Official Action dated Jan. 11, 2007 in U.S. Appl. No. 10/184,190.306U.S. Official Action dated Jan. 17, 2006 in U.S. Appl. No. 10/140,544.307U.S. Official Action dated Jan. 25, 2007 in U.S. Appl. No. 10/608,267.308U.S. Official Action dated Jan. 26, 2005 in U.S. Appl. No. 10/154,630.309U.S. Official Action dated Jul. 15, 2004 in U.S. Appl. No. 09/906,467.310U.S. Official Action dated Jul. 25, 2005 in U.S. Appl. No. 10/179,438.311U.S. Official Action dated Jun. 1, 2006 in U.S. Appl. No. 10/366,141.312U.S. Official Action dated Jun. 14, 2004 in U.S. Appl. No. 09/588,411.313U.S. Official Action dated Jun. 18, 2004 in U.S. Appl. No. 09/818,157.314U.S. Official Action dated Jun. 24, 2005 in U.S. Appl. No. 10/140,544.315U.S. Official Action dated Jun. 3, 2005 in U.S. Appl. No. 10/154,630.316U.S. Official Action dated Jun. 6, 2005 in U.S. Appl. No. 10/164,260.317U.S. Official Action dated Mar. 1, 2005 in U.S. Appl. No. 09/818,157.318U.S. Official Action dated Mar. 12, 2007 cited in U.S. Appl. No. 10/141,712.319U.S. Official Action dated Mar. 17, 2005 in U.S. Appl. No. 09/841,265.320U.S. Official Action dated Mar. 24, 2005 in U.S. Appl. No. 10/141,712.321U.S. Official Action dated Mar. 9, 2007 cited in U.S. Appl. No. 10/426,446.322U.S. Official Action dated May 20, 2005 in U.S. Appl. No. 10/184,298.323U.S. Official Action dated May 26, 2006 in U.S. Appl. No. 09/588,411.324U.S. Official Action dated May 30, 2007 cited in U.S. Appl. No. 09/906,467.325U.S. Official Action dated May 31, 2006 in U.S. Appl. No. 10/141,712.326U.S. Official Action dated May 5, 2005 in U.S. Appl. No. 09/906,467.327U.S. Official Action dated May 6, 2005 in U.S. Appl. No. 09/907,418.328U.S. Official Action dated Nov. 10, 2005 in U.S. Appl. No. 10/164,260.329U.S. Official Action dated Nov. 15, 2005 in U.S. Appl. No. 09/841,265.330U.S. Official Action dated Nov. 2, 2004 in U.S. Appl. No. 10/178,680.331U.S. Official Action dated Nov. 2, 2005 in U.S. Appl. No. 10/184,190.332U.S. Official Action dated Nov. 22, 2005 in U.S. Appl. No. 10/141,712.333U.S. Official Action dated Oct. 10, 2006 cited in U.S. Appl. No. 09/841,265.334U.S. Official Action dated Oct. 4, 2005 in U.S. Appl. No. 10/183,317.335U.S. Official Action dated Oct. 5, 2005 in U.S. Appl. No. 10/179,810.336U.S. Official Action dated Oct. 6, 2004 in U.S. Appl. No. 09/818,157.337U.S. Official Action dated Oct. 6, 2006 cited in U.S. Appl. No. 10/140,544.338U.S. Official Action dated Sep. 2, 2005 in U.S. Appl. No. 10/366,141.339U.S. Official Action dated Sep. 28, 2006 cited in U.S. Appl. No. 10/608,267.340U.S. Official Action dated Sep. 29, 2004 in U.S. Appl. No. 09/907,418.341U.S. Official Action dated Sep. 7, 2006 cited in U.S. Appl. No. 10/155,680.342U.S. Official Action mailed Apr. 1, 2008 cited in U.S. Appl. No. 09/907,418.343U.S. Official Action mailed Apr. 29, 2008 cited in U.S. Appl. No. 09/588,411.344U.S. Official Action mailed Apr. 4, 2008 cited in U.S. Appl. No. 10/155,680.345U.S. Official Action mailed Feb. 15, 2007 in U.S. Appl. No. 10/948,948.346U.S. Official Action mailed Mar. 20, 2008 in U.S. Appl. No. 10/948,948.347U.S. Official Action mailed May 1, 2008 cited in U.S. Appl. No. 10/183,317.348U.S. Official Action mailed Oct. 16, 2008 in U.S. Appl. No. 10/154,630.349U.S. Official Action mailed Oct. 16, 2008 in U.S. Appl. No. 10/948,948.350U.S. Official Action mailed Oct. 18, 2007 in U.S. Appl. No. 10/948,948.351U.S. Official Action mailed Sep. 8, 2006 in U.S. Appl. No. 10/948,948.352User Manual For AddressMate and AddressMate Plus, CoStar Corporation, AddressMate Software, 1994-1995, pp. 1-210.353V. Braganholo, "Updating Relational Databases Through XML Views", Technical Report, Sep. 2002, pp. 1-61.354V. Doroth et al., "Modern Computer Vocabulary," St. Petersburg, BHV-Peterburg, 2001, p. 465 (with English language translation).355Wei Ying-bin et al., "A New Technology ColdFusion of Realizing Dynamic Webpage," 2000, 6 pgs. (English language translation, pp. 1-6).356Wilker, John, "ColdFusion MX Adds J2EE, XML, and Web Services Compatibility", Aug. 9, 2002, http://builder.com.com/5102-6387-104585.html, 3 pp.357Willisson, Pace, et al., "UNIX Man Pages: ispell," http://www.comp.lancs.ac.uk/computing/users/eiamjw/unix/chap8.html, http://www.physics.umn.edu/cgi-bin/man-cgi?spell, http://www.vorlesungen.uni-osnabrueck.de/informatik/shellscript/Html/Man/-Man-NeXT-html/html, http://duplex.hypermart.net/books.bsd/501-504.html, pp. 1-20.358Willisson, Pace, et al., "UNIX Man Pages: ispell," http://www.comp.lancs.ac.uk/computing/users/eiamjw/unix/chap8.html, http://www.physics.umn.edu/cgi-bin/man-cgi?spell, http://www.vorlesungen.uni-osnabrueck.de/informatik/shellscript/Html/Man/�Man�NeXT�html/html, http://duplex.hypermart.net/books.bsd/501-504.html, pp. 1-20.359World Wide Web Consortium, "Document Object Model (DOM) Level 2 Core Specification, Version 1.0", http://www.w3.org/TR/2000/REC-DOM-Level-2-Core-20001113/DOM2-Core.pdf, Nov. 2000, 107 pp.360World Wide Web Consortium, "Document Object Model (DOM) Level 2 Events Specification, Version 1.0", http://www.w3.org/TR/2000/REC-DOM-Level-2-Events-20001113/DOM2-Events.pdf, Nov. 2000, 50 pp.* Cited by examinerReferenced byCiting PatentFiling datePublication dateApplicantTitleUS8412749Jan 16, 2009Apr 2, 2013Google Inc.Populating a structured presentation with new valuesUS8452791Jan 16, 2009May 28, 2013Google Inc.Adding new instances to a structured presentationUS8615707Jan 16, 2009Dec 24, 2013Google Inc.Adding new attributes to a structured presentationUS8924436Apr 1, 2013Dec 30, 2014Google Inc.Populating a structured presentation with new valuesUS8977645Jan 16, 2009Mar 10, 2015Google Inc.Accessing a search interface in a structured presentationUS20140101527 *Oct 10, 2012Apr 10, 2014Dominic Dan SuciuElectronic Media Reader with a Conceptual Information Tagging and Retrieval System* Cited by examinerClassifications U.S. Classification715/825, 715/739International ClassificationG06F17/27, G06F3/048, G06Q30/00Cooperative ClassificationG06Q30/02, G06F17/2785European ClassificationG06Q30/02, G06F17/27SLegal EventsDateCodeEventDescriptionDec 9, 2014ASAssignmentOwner name: MICROSOFT TECHNOLOGY LICENSING, LLC, WASHINGTONFree format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:MICROSOFT CORPORATION;REEL/FRAME:034541/0001Effective date: 20141014Jan 28, 2014FPAYFee paymentYear of fee payment: 4Jul 16, 2001ASAssignmentOwner name: MICROSOFT CORPORATION, WASHINGTONFree format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:REYNAR, JEFF;WANG, ZIYI;AMMERLAAN, MICHAEL;REEL/FRAME:012004/0162;SIGNING DATES FROM 20010712 TO 20010713Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:REYNAR, JEFF;WANG, ZIYI;AMMERLAAN, MICHAEL;SIGNING DATESFROM 20010712 TO 20010713;REEL/FRAME:012004/0162Owner name: MICROSOFT CORPORATION, WASHINGTONFree format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:REYNAR, JEFF;WANG, ZIYI;AMMERLAAN, MICHAEL;SIGNING DATESFROM 20010712 TO 20010713;REEL/FRAME:012004/0162RotateOriginal ImageGoogle Home - Sitemap - USPTO Bulk Downloads - Privacy Policy - Terms of Service - About Google Patents - Send FeedbackData provided by IFI CLAIMS Patent Services