Source: http://www.google.com/patents/US7742953?dq=5490230
Timestamp: 2015-10-09 02:22:21
Document Index: 86321914

Matched Legal Cases: ['Application No. 60', 'Application No. 60', 'Application No. 60', 'Application No. 60', 'Application No. 60', 'Application No. 60', 'Application No. 60', 'Application No. 60', 'Application No. 60', 'Application No. 60', 'Application No. 60', 'Application No. 60', 'Application No. 60', 'Application No. 60', 'Application No. 60', 'Application No. 60', 'Application No. 60', 'Application No. 60', 'Application No. 60', 'Application No. 60', 'Application No. 60', 'Application No. 60', 'Application No. 60', 'Application No. 60', 'Application No. 60', 'Application No. 60', 'Application No. 60', 'Application No. 60', 'Application No. 60', 'Application No. 60', 'Application No. 60', 'Application No. 60', 'Application No. 60', 'Application No. 60', 'Application No. 60', 'Application No. 60', 'Application No. 60', 'Application No. 60', 'Application No. 60', 'Application No. 60', 'Application No. 60', 'Application No. 60', 'Application No. 60', 'Application No. 60', 'Application No. 60', 'Application No. 60', 'Application No. 60', 'Application No. 60', 'Application No. 60', 'Application No. 60', 'Application No. 60', 'Application No. 60', 'Application No. 60', 'Application No. 60', 'Application No. 60', 'Application No. 60', 'Application No. 60', 'Application No. 60', 'Application No. 60', 'Application No. 60', 'Application No. 60', 'Application No. 60', 'Application No. 60', 'Application No. 60', 'Application No. 60', 'Application No. 60', 'Application No. 60', 'Application No. 60', 'Application No. 60', 'Application No. 60', 'Application No. 60', 'Application No. 60', 'Application No. 60', 'Application No. 60', 'Application No. 60', 'Application No. 60', 'Application No. 60', 'Application No. 60', 'Application No. 60', 'Application No. 60', 'Application No. 60', 'Application No. 60', 'Application No. 60', 'Application No. 60', 'Application No. 60', 'Application No. 60', 'Application No. 60', 'Application No. 60', 'Application No. 60', 'Application No. 60', 'Application No. 60', 'Application No. 60', 'Application No. 60', 'Application No. 60', 'Application No. 60', 'Application No. 60', 'Application No. 60', 'Application No. 60', 'Application No. 60', 'Application No. 60', 'Application No. 60', 'Application No. 60']

Patent US7742953 - Adding information or functionality to a rendered document via association ... - Google PatentsSearch Images Maps Play YouTube News Gmail Drive More »Sign inAdvanced Patent SearchPatentsAn action plan data structure for one or more selected rendered documents is described. The data structure contains information specifying an action to perform automatically in response to a text capture from any of the selected rendered documents....http://www.google.com/patents/US7742953?utm_source=gb-gplus-sharePatent US7742953 - Adding information or functionality to a rendered document via association with an electronic counterpartAdvanced Patent SearchPublication numberUS7742953 B2Publication typeGrantApplication numberUS 11/097,828Publication dateJun 22, 2010Filing dateApr 1, 2005Priority dateFeb 15, 2004Fee statusPaidAlso published asEP1747508A2, EP1747508A4, EP1749260A2, EP1749260A4, EP1756704A2, EP1756704A4, EP1756729A2, EP1756729A4, EP1759272A2, EP1759272A4, EP1759273A2, EP1759273A4, EP1759274A2, EP1759274A4, EP1759275A2, EP1759275A4, EP1759276A2, EP1759276A4, EP1759277A2, EP1759277A4, EP1759281A2, EP1759281A4, EP1761841A2, EP1761841A4, EP1763842A2, EP1763842A4, EP1880301A2, EP1880301A4, EP2490152A1, US7421155, US7437023, US7593605, US7596269, US7599580, US7599844, US7606741, US7702624, US7706611, US7707039, US7818215, US7831912, US8005720, US8019648, US8064700, US8214387, US8442331, US8447144, US8515816, US8521772, US8619147, US8799303, US8831365, US20050234851, US20060023945, US20060026078, US20060026140, US20060029296, US20060036462, US20060036585, US20060041538, US20060041590, US20060041828, US20060047639, US20060050996, US20060061806, US20060078207, US20060087683, US20060119900, US20060294094, US20070011140, US20100177970, US20100183246, US20110019919, US20110044547, US20110085211, US20110154507, US20120041941, US20120297277, US20130132367, US20130201527, WO2005096750A2, WO2005096750A3, WO2005096755A2, WO2005096755A3, WO2005098596A2, WO2005098596A3, WO2005098597A2, WO2005098597A3, WO2005098598A2, WO2005098598A3, WO2005098599A2, WO2005098599A3, WO2005098600A2, WO2005098600A3, WO2005098601A2, WO2005098601A3, WO2005098602A2, WO2005098602A3, WO2005098603A2, WO2005098603A3, WO2005098604A2, WO2005098604A3, WO2005098605A2, WO2005098605A3, WO2005098606A2, WO2005098606A3, WO2005098607A2, WO2005098607A3, WO2005098610A2, WO2005098610A3, WO2005114380A2, WO2005114380A3Publication number097828, 11097828, US 7742953 B2, US 7742953B2, US-B2-7742953, US7742953 B2, US7742953B2InventorsMartin T. King, Dale L. Grover, Clifford A. Kushler, James Q. Stafford-FraserOriginal AssigneeExbiblio B.V.Export CitationBiBTeX, EndNote, RefManPatent Citations (660), Non-Patent Citations (169), Referenced by (81), Classifications (97), Legal Events (3) External Links: USPTO, USPTO Assignment, EspacenetAdding information or functionality to a rendered document via association with an electronic counterpart
US 7742953 B2Abstract
An action plan data structure for one or more selected rendered documents is described. The data structure contains information specifying an action to perform automatically in response to a text capture from any of the selected rendered documents.
1. A method in a mobile device for responding to a capture of text from a display of information that includes text, the method comprising:
capturing, using an imaging component of the mobile device, an image of a display of information, wherein the image includes text;
recognizing, using a text recognition component of the mobile device, at least a portion of the text within the captured image;
identifying, via the mobile device, one or more actions associated with the captured text;
presenting, via a display of the mobile device, a menu of user-selectable options associated with the identified one or more actions; and
performing, at the mobile device, the identified one or more actions via a display and speakers of the mobile device, wherein when the action to be performed includes visual elements, performing the action using the display of the mobile device, and when the action to be performed includes audio elements, using the speakers of the mobile device.
2. The method of claim 1, wherein the identified action includes presenting, via the display of the mobile device, information associated with the captured image.
identifying, at the mobile device, a digital counterpart of the display of information based on the captured text; and
wherein identifying one or more actions associated with the captured text includes identifying one or more actions associated with the identified digital counterpart.
determining a location at which the image capture occurred;
wherein identifying one or more actions associated with the captured text includes identifying one or more actions associated with the determined location.
determining an identity of a user that captured the image;
wherein identifying one or more actions associated with the captured text includes identifying one or more actions associated with the determined identify.
6. A computer-readable medium whose contents cause a mobile device to perform a method of performing an action in response to an image of a display of information, the method comprising:
7. A system of one or more components stored in memory of a mobile device and configured to cause a processor of the mobile device to perform an action in response to an image of a display of information, the system comprising:
an imaging component, wherein the imaging component is configured to capture an image of a display of information that includes text;
a text recognition component, wherein the text recognition component is configured to recognize at least a portion of the text within the captured image;
an action identification component, wherein the action identification component is configured to identify one or more performable actions associated with the captured image;
a menu component, wherein the menu component is configured to present, via a display of the mobile device, a menu of user-selectable options associated with the identified one or more actions; and
an action performance component, wherein the action performance component is configured to perform actions that are associated with options selected by a user using a display and speaker of the mobile device.
8. The system of claim 7, wherein the action identification component is configured to identify at least one of the one or more actions by transmitting the recognized text to a search engine remote from the mobile device and receiving a search result from the remote search engine that includes the identified action.
9. The system of claim 7, wherein the identified one or more performable actions includes an action that retrieves real-time information associated with the captured display of information and wherein the action performance component presents the real-time information to the user.
10. The system of claim 7, wherein the identified one or more performable actions includes an action that retrieves location-based information associated with the captured display of information and wherein the action performance component presents the location information to the user.
11. The system of claim 7, wherein the identified one or more performable actions includes an action that stores the information associated with the captured display of information in memory of the mobile device and wherein the action performance component presents the stored contact information to the user.
This application is related to, and incorporates by reference in their entirety, the following U.S. Patent Applications, filed concurrently herewith: U.S. patent application Ser. No. 11/097,961, entitled METHODS AND SYSTEMS FOR INITIATING APPLICATION PROCESSES BY DATA CAPTURE FROM RENDERED DOCUMENTS, U.S. patent application Ser. No. 11/097,093, entitled DETERMINING ACTIONS INVOLVING CAPTURED INFORMATION AND ELECTRONIC CONTENT ASSOCIATED WITH RENDERED DOCUMENTS, U.S. patent application Ser. No. 11/098,038, entitled CONTENT ACCESS WITH HANDHELD DOCUMENT DATA CAPTURE DEVICES, U.S. patent application Ser. No. 11/098,014, entitled SEARCH ENGINES AND SYSTEMS WITH HANDHELD DOCUMENT DATA CAPTURE DEVICES, U.S. patent application Ser. No. 11/097,103, entitled TRIGGERING ACTIONS IN RESPONSE TO OPTICALLY OR ACOUSTICALLY CAPTURING KEYWORDS FROM A RENDERED DOCUMENT, U.S. patent application Ser. No. 11/098,043, entitled SEARCHING AND ACCESSING DOCUMENTS ON PRIVATE NETWORKS FOR USE WITH CAPTURES FROM RENDERED DOCUMENTS U.S. patent application Ser. No. 11/097,981, entitled INFORMATION GATHERING SYSTEM AND METHOD, U.S. patent application Ser. No. 11/097,089, entitled DOCUMENT ENHANCEMENT SYSTEM AND METHOD, U.S. patent application Ser. No. 11/097,835, entitled PUBLISHING TECHNIQUES FOR ADDING VALUE TO A RENDERED DOCUMENT, U.S. patent application Ser. No. 11/098,016, entitled ARCHIVE OF TEXT CAPTURES FROM RENDERED DOCUMENTS, U.S. patent application Ser. No. 11/097,833, entitled AGGREGATE ANALYSIS OF TEXT CAPTURES PERFORMED BY MULTIPLE USERS FROM RENDERED DOCUMENTS, U.S. patent application Ser. No. 11/097,836, entitled ESTABLISHING AN INTERACTIVE ENVIRONMENT FOR RENDERED DOCUMENTS, U.S. patent application Ser. No. 11/098,042, entitled DATA CAPTURE FROM RENDERED DOCUMENTS USING HANDHELD DEVICE, and U.S. patent application Ser. No. 11/096,704, entitled CAPTURING TEXT FROM RENDERED DOCUMENTS USING SUPPLEMENTAL INFORMATION.
This application claims priority to, and incorporates by reference in their entirety, the following U.S. Provisional Patent Applications: Application No. 60/559,226 filed on Apr. 1, 2004, Application No. 60/558,893 filed on Apr. 1, 2004, Application No. 60/558,968 filed on Apr. 1, 2004, Application No. 60/558,867 filed on Apr. 1, 2004, Application No. 60/559,278 filed on Apr. 1, 2004, Application No. 60/559,279 filed on Apr. 1, 2004, Application No. 60/559,265 filed on Apr. 1, 2004, Application No. 60/559,277 filed on Apr. 1, 2004, Application No. 60/558,969 filed on Apr. 1, 2004, Application No. 60/558,892 filed on Apr. 1, 2004, Application No. 60/558,760 filed on Apr. 1, 2004, Application No. 60/558,717 filed on April 1, 2004, Application No. 60/558,499 filed on Apr. 1, 2004, Application No. 60/558,370 filed on April 1, 2004, Application No. 60/558,789 filed on Apr. 1, 2004, Application No. 60/558,791 filed on Apr. 1, 2004, Application No. 60/558,527 filed on Apr. 1, 2004, Application No. 60/559,125 filed on Apr. 2, 2004, Application No. 60/558,909 filed on Apr. 2, 2004, Application No. 60/559,033 filed on Apr. 2, 2004, Application No. 60/559,127 filed on Apr. 2, 2004, Application No. 60/559,087 filed on Apr. 2, 2004, Application No. 60/559,131 filed on Apr. 2, 2004, Application No. 60/559,766 filed on Apr. 6, 2004, Application No. 60/561,768 filed on Apr. 12, 2004, Application No. 60/563,520 filed on April 19, 2004, Application No. 60/563,485 filed on April 19, 2004, Application No. 60/564,688 filed on Apr. 23, 2004, Application No. 60/564,846 filed on April 23, 2004, Application No. 60/566,667, filed on April 30, 2004, Application No. 60/571,381 filed on May 14, 2004, Application No. 60/571,560 filed on May 14, 2004, Application No. 60/571,715 filed on May 17, 2004, Application No. 60/589,203 filed on Jul. 19, 2004, Application No. 60/589,201 filed on Jul. 19, 2004, Application No. 60/589,202 filed on Jul. 19, 2004, Application No. 60/598,821 filed on Aug. 2, 2004, Application No. 60/602,956 filed on Aug. 18, 2004, Application No. 60/602,925 filed on Aug. 18, 2004, Application No. 60/602,947 filed on Aug. 18, 2004, Application No. 60/602,897 filed on Aug. 18, 2004, Application No. 60/602,896 filed on Aug. 18, 2004, Application No. 60/602,930 filed on Aug. 18, 2004, Application No. 60/602,898 filed on Aug. 18, 2004, Application No. 60/603,466 filed on Aug. 19, 2004, Application No. 60/603,082 filed on Aug. 19, 2004, Application No. 60/603,081 filed on Aug. 19, 2004, Application No. 60/603,498 filed on Aug. 20, 2004, Application No. 60/603,358 filed on Aug. 20, 2004, Application No. 60/604,103 filed on Aug. 23, 2004, Application No. 60/604,098 filed on Aug. 23, 2004, Application No. 60/604,100 filed on Aug. 23, 2004, Application No. 60/604,102 filed on Aug. 23, 2004, Application No. 60/605,229 filed on Aug. 27, 2004, Application No. 60/605,105 filed on Aug. 27, 2004, Application No. 60/613,243 filed on Sep. 27, 2004, Application No. 60/613,628 filed on Sep. 27, 2004, Application No. 60/613,632 filed on Sep. 27, 2004, Application No. 60/613,589 filed on Sep. 27, 2004, Application No. 60/613,242 filed on Sep. 27, 2004, Application No. 60/613,602 filed on Sep. 27, 2004, Application No. 60/613,340 filed on Sep. 27, 2004, Application No. 60/613,634 filed on Sep. 27, 2004, Application No. 60/613,461 filed on Sep. 27, 2004, Application No. 60/613,455 filed on Sep. 27, 2004, Application No. 60/613,460 filed on Sep. 27, 2004, Application No. 60/613,400 filed on Sep. 27, 2004, Application No. 60/613,456 filed on Sep. 27, 2004, Application No. 60/613,341 filed on Sep. 27, 2004, Application No. 60/613,361 filed on Sep. 27, 2004, Application No. 60/613,454 filed on Sep. 27, 2004, Application No. 60/613,339 filed on Sep. 27, 2004, Application No. 60/613,633 filed on Sep. 27, 2004, Application No. 60/615,378 filed on Oct. 1, 2004, Application No. 60/615,112 filed on Oct. 1, 2004, Application No. 60/615,538 filed on Oct. 1, 2004, Application No. 60/617,122 filed on Oct. 7, 2004, Application No. 60/622,906 filed on Oct. 28, 2004, Application No. 60/633,452 filed on Dec. 6, 2004, Application No. 60/633,678 filed on Dec. 6, 2004, Application No. 60/633,486 filed on Dec. 6, 2004, Application No. 60/633,453 filed on Dec. 6, 2004, Application No. 60/634,627 filed on Dec. 9, 2004, Application No. 60/634,739 filed on Dec. 9, 2004, Application No. 60/647,684 filed on Jan. 26, 2005, Application No. 60/648,746 filed on Jan. 31, 2005, Application No. 60/653,372 filed on Feb. 15, 2005, Application No. 60/653,663 filed on Feb. 16, 2005, Application No. 60/653,669 filed on Feb. 16, 2005, Application No. 60/653,899 filed on Feb. 16, 2005, Application No. 60/653,679 filed on Feb. 16, 2005, Application No. 60/653,847 filed on Feb. 16, 2005, Application No. 60/654,379 filed on Feb. 17, 2005, Application No. 60/654,368 filed on Feb. 18, 2005, Application No. 60/654,326 filed on Feb. 18, 2005, Application No. 60/654,196 filed on Feb. 18, 2005, Application No. 60/655,279 filed on Feb. 22, 2005, Application No. 60/655,280 filed on Feb. 22, 2005, Application No. 60/655,987 filed on Feb. 22, 2005, Application No. 60/655,697 filed on Feb. 22, 2005, Application No. 60/655,281 filed on Feb. 22, 2005, and Application No. 60/657,309 filed on Feb. 28, 2005.
FIG. 4 is a block diagram showing some of the components typically incorporated in at least some of the computer systems and other devices used by the system.
FIG. 5 is a data flow diagram showing a typical manner in which the system generates and applies markup.
A system for adding information or functionality to a rendered document, typically by associating this information or functionality with the electronic counterpart of the document, (“the system”) is described. In some embodiments, this added information takes two forms: “action plans” that specify how to respond to text captures by a user from any rendered document, from rendered documents among a set of rendered documents, from a particular rendered document, or from a particular portion of a particular rendered document; and “rendering plants” that specify ways in which all electronic documents, electronic documents among a set of electronic documents, a particular electronic document, or particular portion of a particular electronic document should be rendered to better support user text captures. This added information is sometimes referred to herein as “markup,” though it differs in some significant respects from conventional notions of markup. The generation and application of this added information is further discussed in section 5 above.
Applications of the system may take advantage of the association of extra functionality or data with part or all of a document. For example, advertising applications discussed in Section 10.4 may use an association of particular advertising messages or subjects with portions of a document. This extra associated functionality or data can be thought of as one or more overlays on the document, and is referred to herein as “markup”. The next stage of the process 130, then, is to identify any markup relevant to the captured data. Such markup may be provided by the user, the originator, or publisher of the document, or some other party, and may be directly accessible from some source 132 or may be generated by some service 134. In various embodiments, markup can be associated with, and apply to, a rendered document and/or the digi