Abstract:
Disclosed is a method and system for applying summaries to electronic content by generating an Essence Layer File which includes user generated annotations highlighting important parts of given electronic content. The Essence Layer file is applied on top of and is anchored to the electronic content rather than editing the saved file that the electronic content is stored as. Essence Layer Files paired with electronic content are streamed to consumers through both direct and social network distribution systems. The consumers rate the value of the summaries thereby creating a crowd-sourced merit system.

Description:
CROSS REFERENCE TO RELATED APPLICATIONS 
       [0001]    This application claims priority to U.S. Provisional Patent Application No. 62/134,522 entitled “METHOD FOR PROVIDING SELECTION OVERLAYS ON ELECTRONIC CONSUMER CONTENT” filed Mar. 17, 2015 and U.S. Provisional Patent Application No. 62/142,710 having the same title and filed on Apr. 3, 2015. The No. 62/134,522 application and No. 62/142,710 application are incorporated by reference in their entirety. 
     
    
     TECHNICAL FIELD 
       [0002]    teachings relate to consuming and enriching electronic content on web enabled devices and sharing it over the Internet and more specifically to consuming web pages, PDFs and eBooks (ePubs), videos and audio recordings on PCs and mobile devices, enriching such content with special annotations, and sharing such enriched content or annotations via the Internet and social media channels. 
       BACKGROUND 
       [0003]    When electronic content of any form is consumed by a person interested in gathering information, only a fraction of that content is really relevant. The rest is not essential to understand the highlights or core of the content. Therefore, consuming content can be very ineffective and tiring, because people have to read/browse/scan though irrelevant passages. Experience shows that in average less than 20% of available content is relevant or essential to a consumer. 
         [0004]    Accordingly, there is a need for a system and method for tools and services to enable consumers to “essentialize” electronic content as a community and create a ranking system for the summaries generated by members of the community so that people can easily identify and directly consume the relevant parts of electronic content through both personal and crowd-sourced rating schemes. 
       SUMMARY 
       [0005]    embodiments contemplate a variety of improved methods and systems for enriching and consuming electronic content on PCs and mobile devices. 
         [0006]    Embodiments include methods and systems for enabling a community of users to receive electronic content, generate an Essence Layer File which includes annotations and highlights to the electronic content mapped to overlay on top of the electronic content, and publish the Essence Layer File with the electronic content to the Internet. 
         [0007]    Additional elements include providing for a personal and community rating system for the Essence Layer Files generated by individual users. Further elements include a plurality of importance levels for highlights, user libraries, a community stream for essenced electronic content, and generating brief summaries of electronic content. 
     
    
     
       BRIEF DESCRIPTION OF THE FIGURES 
         [0008]    These and other objects, features and characteristics of the present invention will become more apparent to those skilled in the art from a study of the following detailed description in conjunction with the appended claims and drawings, all of which form a part of this specification. In the drawings: 
           [0009]      FIG. 1  illustrates the combination of an original document with an Essence Layer File; 
           [0010]      FIG. 2  illustrates community action utilizing Essence Layer Files; 
           [0011]      FIG. 3  illustrates a consumer selecting and applying an Essence Layer File from an online repository; 
           [0012]      FIG. 4  illustrates essence original document formats; 
           [0013]      FIG. 5  is a pictorial illustration of essenced HTML content; 
           [0014]      FIG. 6  is a pictorial illustration of essence HTML content with a muted background; 
           [0015]      FIG. 7  is a pictorial illustration of essence HTML content wherein non-highlighted content has been removed; 
           [0016]      FIG. 8A  is a pictorial illustration of essenced video content; 
           [0017]      FIG. 8B  is a pictorial illustration of a selected portion of essence video content; 
           [0018]      FIG. 9  is a pictorial illustration of a feed of essenced HTML content sorted by creation date; 
           [0019]      FIG. 10  is a pictorial illustration of essenced HTML content accessed from an Essence Library; 
           [0020]      FIG. 11  is a pictorial illustration of a essence HTML content displayed with a Essencer info; 
           [0021]      FIG. 12  is a user interface illustration for essenced video and audio content; 
       
    
    
     DETAILED DESCRIPTION 
       [0022]    At the core of Essentializing System is the Essence concept. An “Essence” always is based on an “existing electronic content” and is created by a person (the “essencer” or “creator”) who is analyzing said existing content and who is defining a “set of annotations”, a “purpose message”, an “identifying image”, a “list of tags”. An Essence can also have an “Essence discussion stream”. Several Essences can be grouped together into a “Collection” of Essences. Essences can be generated for numerous types of electronic content such as HTML (Web pages), PDF, eBooks, Videos (Youtube, MP4, etc), Audio recordings (MP3, streaming formats, etc), Text documents, Emails, and other suitable electronic document formats. For the purposes of this disclosure the term “essencer” refers to a person creating an Essence. An Essence always has a link to the essencer. 
         [0023]    Referring now to  FIG. 1 , a combination of an original document with an Essence Layer File. An original document (shown left) is combined with an Essence Layer File (shown mid) to create and essenced document (shown right). The Essence Layer File is a set of annotations. An “annotation” refers to an element of electronic content (e.g. a piece of text, an image, or a piece of video) and can contain one or more of the following: A highlight marking the content (the highlight can have different colors), an importance level that ranks the annotation relative to other annotations, levels for “agreement” and “disagreement” and also for “do not understand”, a multi-media comment created by essencer, or such a comment can also contain links to web resources, external documents, other annotations, or other Essences. An Essence Layer File can be applied and stripped from an original document according to viewer specifications. Further multiple Essence Layer Files can be layered on top of a single original document. 
         [0024]    An essenced document includes the essence annotations along with the original document. An essenced document would also include an identifying image selected by essencer from the list of images of electronic content or it can be an animated image combining all multiple images or video clip (e.g. an animated GIF). Essenced documents would further include a purpose message created by the essencer and is a multi-media comment. Such a comment can also contain links to web resources, external documents, annotations in the Essence, or other Essences. Essenced documents include an Essence discussion stream and sorting tags. 
         [0025]    Referring now to  FIG. 2 ,  FIG. 2  illustrates community action utilizing Essence Layer Files. To begin, an essencer watches, reads or analyzes original electronic content and then generates an Essence and applies the Essence to the original electronic content to create and essenced document. The essencer will have additional editorial controls over the generated essence, and may save the Essence in a personal library. The essencer can further share the Essence with others. Thus the essenced document can be shared over social networks, email, messaging applications, direct links, personal channels (such as a YouTube channel), or other suitable methods to disseminate electronic content known in the art. The essenced document is shared with consumers who then read, watch, analyze the essenced document and may provide a rating for the specific Essence, or Essences, in case there are multiple Essences layered on a single original electronic content. The Essence rating system then ranks the Essences that have been shared to a public database such that higher ranked ones would be placed higher in search results such that more popular essencers would receive a greater number of views and the community as a whole would receive the highest quality summaries of the content that mattered to them. 
         [0026]    The rating system could allow for personal rating to matter more than average community ratings such that a given consumer would be able to tailor the experience to that consumer&#39;s particular preferences. Further different kinds of content could be categorized separately into sub-content such that community rating pertained to a relevant sub-community viewing the given content. An illustrative example of sub-content would be U.S. court opinions, and legal blogs; while the sub-community would consist of lawyers and legal professionals who cared about concise summaries of said opinions and blogs. 
         [0027]    Referring now to  FIG. 3 ,  FIG. 3  illustrates a consumer selecting and applying an Essence Layer File from an online repository. The same content often exists in multiple embodiments, which can either be in multiple documents (e.g. as PDF with file name A and with file name B), in different content formats (e.g. as HTML and as PDF), in different device form factors (e.g. as HTML for Desktop and for smartphones), under different URLs, or embedded in other different content (e.g. the same news text can appear in a web page of newspaper 1 and of newspaper 2). There are existing algorithms that can identify and match documents in multiple embodiments and there are algorithms for anchoring existing annotations in various document formats. However there is no integrated mechanism that would span both and that would allow a human interaction in order to give hints for improving the matching algorithm. The Essence System offers a mechanism that integrates both, the automatic matching of documents in multiple embodiments and the automatic anchoring of existing annotations in various document formats. It also offers a human interaction for pointing at relevant parts in the content in order to give hints for improving the matching and the anchoring algorithm. 
         [0028]    Referring now to  FIG. 4 ,  FIG. 4  illustrates essence original document formats.  FIG. 4  is self-explanatory. 
         [0029]    Referring now to  FIG. 5 ,  FIG. 5  is a pictorial illustration of essenced HTML content. The essenced HTML page displays multiple levels of essence annotation. Examples include: underlining, adjusting font size, and highlighting of various colors. Annotations come in multiple, graduated importance levels. Each progressing level would use increasingly conspicuous annotations. essencers would be encouraged to properly use importance levels through the rating system. essencers who creates questionable or misleading annotations or importance levels would become down-voted and their Essences would see less circulation. 
         [0030]    Referring now to  FIG. 6 ,  FIG. 6  is a pictorial illustration of essenced HTML content with a muted background. Similarly to  FIG. 5 , essenced HTML documents would appear to consumers with the Essence Layer File overlaid on the original electronic content; however, the Essence Layer File can be configured to obscure all content that has not been annotated. Obscuring non-annotated content could involve overlaying a color filter on top of the non-essential content. In an essenced ePub, chapters that did not have any annotations would also be obscured in the table of contents. 
         [0031]    Referring now to  FIG. 7 ,  FIG. 7  is a pictorial illustration of essenced HTML content wherein non-annotated content below a user-selectable importance level has been removed. Rather than obscuring non-annotated content, the non-annotated may be simply removed. 
         [0032]    Referring now to  FIGS. 8A and 8B , where  FIG. 8A  is a pictorial illustration of essenced video content and  FIG. 8B  is a pictorial illustration of a selected portion of essence video content. Moving the mouse over the list illuminates the time frame of the annotation: Clicking on a highlight starts play back of that portion. Clicking on the “Play all highlights” plays back the highlighted parts of the video all non-highlighted parts are either not played at all or are played back in very high speed (fast forward). Furthermore user can filter the list according to importance levels of annotations thus allowing to play only the most important parts. Audio recordings are similar to videos, where the individual audio pieces are highlighted. The functionality also is the same. 
         [0033]    Creating Essences for videos can be a cumbersome and time-consuming task, so quick hot controls should be established to aid in the task. A key function is positioning the current video cursor and setting start and end points of annotations. When the essencer watching the video reaches a part in the video that he/she wants to create an annotation for, then the essencer needs to find the correct start and end points for the annotation. This may require going forth and back in the video several times to identify the ideal start point. Some embodiments support this special need by offering the keyboard and mouse/touch control functions in Table 1 below 
         [0000]    
       
         
               
               
               
             
           
               
                 TABLE 1 
               
               
                   
               
               
                 Function 
                 Key 
                 Mouse/Touch 
               
               
                   
               
             
             
               
                 Start and stop replay 
                 SPACE 
                 Push play button 
               
               
                 Move time cursor left or right 
                 &lt;and&gt; 
                 Drag cursor 
               
               
                 1 sec 
               
               
                 Move time cursor left or right 
                 SHIFT-&lt;and SHIFT-&gt; 
                 Drag cursor 
               
               
                 10 sec 
               
               
                 Create new annotation at 
                 n 
                 Push new annotation button 
               
               
                 current cursor 
               
               
                 Set start annotation at current 
                 i 
                 Drag left annotation handle 
               
               
                 cursor 
               
               
                 Set end annotation at current 
                 o 
                 Drag left annotation handle 
               
               
                 cursor 
               
               
                 Edit text of current annotation 
                 t 
                 Click/touch annotation bar in 
               
               
                   
                   
                 control area 
               
               
                   
               
             
          
         
       
     
         [0034]    When the cursor or the left or right annotation handles are moved by mouse/touch or by keyboard, then the times are temporarily displayed above the corresponding element. The essencer may also create temporary markers. While watching the video, the essencer might want to mark interesting positions in the video in order to create annotations later on. User interface offers a function to setting temporary markers at the current cursor position, that could be done simply using the “new annotation” function and not setting an end. 
         [0035]    Navigating essenced video content would also have special controls. Sample controls are provided in Table 2 below. 
         [0000]    
       
         
               
               
               
             
           
               
                 TABLE 2 
               
               
                   
               
               
                 Function 
                 Key 
                 Mouse/Touch 
               
               
                   
               
             
             
               
                 Position to an annotation 
                 Up and 
                 Click on an annotation in the 
               
               
                   
                 Down 
                 Highlights list 
               
               
                 Position to the next annotation 
                 Down 
                 Click on the next annotation in 
               
               
                   
                   
                 the Highlights list 
               
               
                 Position to the previous 
                 Up 
                 Click on the previous 
               
               
                 annotation 
                   
                 annotation in the Highlights 
               
               
                   
                   
                 list 
               
               
                 Jump to the start of current 
                 s 
                 Push/touch the left annotation 
               
               
                 annotation 
                   
                 handle in the control area 
               
               
                 Jump to the start of current 
                 e 
                 Push/touch the right 
               
               
                 annotation 
                   
                 annotation handle in the 
               
               
                   
                   
                 control area 
               
               
                   
               
             
          
         
       
     
         [0036]    Once created, essenced video content would require an identifying image or animated image. Each annotation can have one or more images that serve as identifying images. For a given annotation the user interface automatically suggests several images from which a user can select one or more identifying images. The selected images would be automatically transformed into a minimal size image (in case of a single image) or into an animated GIF or another animated image format (in case of multiple images). Additionally the user interface offers the essencer to choose the identifying image for the Essence by offering options for the selection. Such options include: one single static image out of all identifying images of all annotations, one animated image (e.g. animated GIF) out of the animated identifying images of all annotations, or an animated image (e.g. animated GIF) created of all identifying images of all annotations. 
         [0037]    An additional use of annotations in essenced video or audio content would involve nested annotations. Nested annotations are those found within other, larger annotations. 
         [0038]    Referring now to  FIG. 9 ,  FIG. 9  is a pictorial illustration of a feed of essenced HTML content filtered by certain user-selectable criteria like subject tag, search string, creating user and sorted by several user selectable sorting criteria like creation date. Users of the feed of essenced content would be presented with a plurality of essenced content stored in an Essence Library. The Essence Library would present consumers with essenced content attuned to that consumer&#39;s own personal preferences and ratings. If multiple Essences on given content were available and rated highly enough, the Essence Library could optionally present these as a single entry. Each entry would contain either the essencer&#39;s written purpose statement, or only those annotations with the highest level of importance. Additionally, this Essence Library would show tags associated to the Essences. The Essence Library can also be searched with a search bar and allows for offline viewing of essenced content. 
         [0039]    Referring now to  FIG. 10 ,  FIG. 10  is a pictorial illustration of essenced HTML content accessed from an Essence Library. When accessing essenced content from the Essence Library, a consumer is provided with special controls on the top of the user interface. These controls allow for operations such as filtering essenced content according to importance levels or rating essencers. 
         [0040]    Referring now to  FIG. 11 ,  FIG. 11  is a pictorial illustration of a essence HTML content displayed with essencer info. In one embodiment, when an Essence is shared and a recipient (consumer) navigates to the shared link, the opens the sharing view of an Essence. At the top of the sharing view is the sharing banner, which includes an image of essencer (or an avatar image), a sharing message which commonly would be the purpose message of the Essence but which can be modified, and finally the sharing banner could contain links to external resources or to annotations in the content (as shown in the image above). The view controls allow the consumer to select one content view of the Essence (as shown in  FIG. 5  to  FIG. 7 ). An optional discussion stream which can be shown or hidden and which is usually located at the bottom or the right side of the page (not pictured). 
         [0041]    Referring now to  FIG. 12 ,  FIG. 12  is a user interface illustration for essenced video and audio content. Video or audio content would also be displayed in the Essence Library. The entry would contain basic information included in an Essence, as well as a drop down pane which would include individual annotations, and nested annotations, all of which could be played individually. 
         [0042]    An integration of an essence file viewing application with external applications and reading devices can be very useful for multiple purposes, for example, in order to display Essence information in the external applications or reading devices or open content that is loaded in external applications in the presently invented system in order to create or consume essenced content execute other functions of integration. Accordingly, the essence viewer would integrate with external applications and devices such as Evernote, Email clients like Outlook and Mozilla Thunderbird, Microsoft Office applications like Word, eBook Reader apps and devices, web browsers, and other suitable applications known in the art.