Abstract:
This invention is a method of analyzing and preparing electronic text in such a way as to set values for each word in terms of recognizability, comprehensibility, and parts of speech for later emphasis and marking for printing or display on an electronic device. When used on electronic display devices it further employs methods which permit the user to limit eye movement by displaying such text one or a few words at a time. This invention also enhances the ability of small electronic devices to display textual information by providing a method of display which is more suitable for small display areas. The invention is made up of two sections. The first analyzes the text to be displayed and grades each word in such a way as to substantially anticipate the difficulty in understanding each word the reader will have when it subsequently is displayed. The first section then tags each word with several values creating a file which can then be read by the second section which then uses the tags to determine how the word is to be displayed. Emphasis and de-emphasis is provided through length of display, color, size, and opacity. Provision is also made for the inclusion of graphics, videos, and audio.

Description:
CROSS-REFERENCE TO RELATED APPLICATIONS 
   This application claims priority to U.S. provisional patent application Ser. No. 60/477,641, filed Jun. 11, 2003, which is relied on and incorporated herein by reference. 

   TECHNICAL FIELD OF THE INVENTION 
   This invention relates to text processing and more particularly, systems for computational linguistics and more particularly to a method and apparatus for annotating documents, either automatically or manually, for the purpose of displaying text more effectively. 
   BACKGROUND OF THE INVENTION 
   Research into eye movement during the visual reading process began around 1879 by a French ophthalmologist, Professor Emile Javal. He concluded that the eyes stop on every word while reading. Professor Javal showed that the eyes could process several letters, and possibly multiple words per glance. He further determined that rather than move in a continuous sweeping motion, the eyes move in alternating jumps and pauses across a line of text. The jumping movements, called saccades, take approximately 20 milliseconds, while the pauses (referred to as fixations) last approximately 150-300 milliseconds. It is only during the fixations, when the eyes are still, that reading can take place. 
   The US Air Force originally used tachistoscopic devices to aid pilots in identifying aircraft by gradually reducing the size and time of flashing images. This technique was later adapted to flashing words. Though showing promise, the technology of the time limited its practical use. 
   From its inception the computer has been under scrutiny with regard to human interaction. Countless studies and experiments have been conducted specific to productivity and how conveyance of the written word could be communicated more effectively. Though modern computers offer many possibilities for the display of text not available previously, most computer applications display text in a way similar to that of paper. Not only does this not take advantage of the possibilities available through computer technology, but in many ways is inferior to that of paper. One alternative, however, uses a completely different approach. Rather than emulating the look of a page, the zero eye movement (ZEM) method (also referred to as rapid serial visual presentation (RSVP)) presents words singularly or in small groups, replacing one image by another within the same field of focus. Information delivered with this method eliminates the time wasted while moving the eyes and improves reading speed. This delivery technique also reduces eye muscle fatigue and in turn, the effects associated with disabilities such as Muscular Degeneration and Dyslexia, as well as assisting those with impaired vision. Though products based upon this technique have been offered, none have been commercially successful. This may be explained by the fact that the flow of the information has been independent of its comprehensibility to the user. 
   This method describes a process of displaying words in a manner which takes into account context, number of characters, relevance, similarity and familiarity. Through analysis of the text for these characteristics, values are assigned to each word and display is effected dynamically. My invention analyzes documents, creates a table of values for each word, analyzes each word in relation to others in each sentence, paragraph and document and then assigns to it a value which is used to display the word in a manner most conducive to comprehension. In addition to the length of time each word is displayed other means of varying emphasis are employed. These include the varying of color, size, transparency background and position on the screen. Although the main use of such analysis is for the display on an electronic device the values could also be used to vary the appearance of printed text. 
   Analysis of documents to determine the difficulty for the reader has long been practiced. For instance, Gunning&#39;s Fog Index derives a readability quotient by counting the number of characters, words, sentences, and paragraphs, and then through a formula of averaging and calculation assigns a grade of difficulty. Other similar analysis methods have been developed for individual words for assessing values to words as objects. 
   SUMMARY OF THE INVENTION 
   The present invention describes a process of displaying words in a manner which takes into account context, number of characters, relevance, similarity and familiarity. Through analysis of the text for these characteristics, values are assigned to each word and display is effected dynamically. 
   The present invention analyzes documents, creates a table of values for each word, analyzes each word in relation to others in each sentence, paragraph and document and then assigns to it a value which is used to display the word in a manner most conducive to comprehension. In addition to the length of time each word is displayed other means of varying emphasis are employed. These include the varying of color, size, transparency, background and position on the screen. Although the main use of such analysis is for the display on an electronic device, the values could also be used to vary the appearance of printed text. 
   In one aspect of the invention, a system is provided for presenting a plurality of words in an electronic document to a viewer to facilitate comprehension and control display and speed of delivery. A plurality of knowledge databases are used in assigning a value to each word in the electronic document. The system includes an annotation module having a cognitive cluster parser and an analysis engine that interact with the plurality of knowledge databases to generate a first tagged file of assigned values for each word. A subjective analysis module having a compiler engine and an author interface processes the first tagged file to generate a second tagged file of values. An objective analysis module having a property editor processes the second tagged file to generate a property deliverable file that dynamically controls the sequential presentation of the words in the electronic document to the viewer. The system also includes a delivery display module operative with the property deliverable file to print or display the words in the electronic document. 
   In another aspect of the invention, a method is provided for presenting a plurality of words in an electronic document to a viewer to facilitate comprehension and control display and speed of delivery. The method includes assigning a value to each word in the electronic document using a knowledge database; generating a first tagged file of assigned values for each word; processing the first tagged file to generate a second tagged file of values; processing the second tagged file to generate a property deliverable file that dynamically controls the sequential presentation of the words in the electronic document to the viewer; and presenting the words in the electronic document to the viewer on a display device or printer. 

   
     BRIEF DESCRIPTION OF THE DRAWINGS 
       FIG. 1  is a block diagram illustrating the basic flow of the program in an embodiment of the invention. 
       FIG. 2  is a more detailed illustration of the Collection and Annotation Module of the program in an embodiment of the invention. 
       FIG. 3  is a more detailed illustration of the Subjective Analysis Module of the program in an embodiment of the invention. 
       FIG. 4  is a more detailed illustration of the Objective Analysis Module of the program in an embodiment of the invention. 
       FIG. 5  is a more detailed illustration of the Delivery Display Module of the program in an embodiment of the invention. 
   

   DETAILED DESCRIPTION OF THE INVENTION 
     FIG. 1  shows a basic flow chart illustrating the processing and combining of several files and their eventual display according to values attached to the files during the processing. This invention processes a Machine Coded Text File  1  through a Collection Annotation Module  2  using a collection of Knowledge Data Bases  3  to create a Heavily Tagged File  4  which is further refined and can be combined with Imagery Files  6  and Audio Files  7  through a Subjective Analysis Module  5  to create an Intelligent File  8 . The Intelligent File  8  can then be further processed and modified through the Objective Analysis Module  9  using a Preference File  993  to create a Property Deliverable File  11  which can then be played through the Delivery Display Module  11  to create a Printed Document  12  or a Visual Audio Experience  13 . 
   In greater detail, this invention processes a machine coded text file  1  such as an ASCII or a word processor file and can combine it with Imagery files  6  (graphical or video) and/or audio files  7 . It sequentially tags each word for the purpose of later emphasis (or de-emphasis) through a process of analysis and valuing. This analysis, valuing, and tagging is done in several stages. The first stage, which takes place in the Analysis and Annotation Module depicted in  FIG. 2 , analyzes the text for small groups of words which are usually read together with one pause of the eye. The Cognitive Cluster Parser  21  compares text to a Cognitive Cluster Knowledge Data Base  31  contained within the collection of Knowledge Data Bases  3 . Such common word pairings as “no one” and “in to” are grouped so that afterwards they will be treated as one word, a cognitive cluster. The resulting Cognitively Parsed File  22  is then analyzed in the second stage by the Analysis Engine  3 . The Analysis Engine  23  accesses the Knowledge Data Bases  3  and performs analysis on the file to create values for rarity, graphical similarity, redundancy, capitalization, sentence position, part of speech, character count, and context. 
   In the first of these processes, each word is compared to a Rarity Data Base  32  for the language and is assigned a value from the knowledge base indicating its rarity of use in the language as a whole. A high rarity value indicates comparative rarity. Alternatively, this knowledge base can be customized for various disciplines so that words that are rare in common use but not so rare in a particular discipline are not given higher weight than is necessary for the intended reader. In the second process, each word is compared to a Graphical Similarity Data Base  33  of words which are graphically similar to other words. If found there it is given a value. A greater value indicates that the word is more easily mistaken for another graphically similar word than a word given a lesser value. In the third process, each word is given a redundancy value. To derive this value each word is compared to each subsequent word in the document and each subsequent reappearance of the word is given a value of one for each reappearance. The fourth of these processes analyzes each word in the document and values those that are capitalized. The fifth process analyzes the document for the relative position of each word in a sentence and sets a value according to its position. The sixth process compares each word along with its surrounding words with a Parts of Speech Data Base  34  to determine its part of speech. A value is then assigned according to its part of speech. The seventh process counts each character in the word or cognitive cluster and assigns that value as a tag. The eighth process compares each word along with the words which surround it to a Contextual Data Base and computes a value of importance based upon context. These values are all tagged to each individual word to create a Heavily Tagged File  4 . 
   The Subjective Analysis Module depicted in  FIG. 3  further processes the Heavily Tagged File  4 . The Compiler Engine  51  uses the values in this file to derive values for Recognizability  531  and Comprehensibility  532 . Each of these two values are a result of applying an algorithm to some or all of the values previously generated. The choice of which of these values is used and how much weight is assigned to each value is given to the operator using the Ratio Definitions function  524  of the Author Interface  52 . These values are the first and second tags used to create an Intelligently Tagged File  8 . The third value tagged to each word is the Part of Speech Value  533  which is passed on unchanged to this file. Using the Tempo function  522  of the Author Interface  52 , the operator can optionally add a Tempo Value Tag  534  to each word. This tag enables an author or editor to differentiate the tempo at which the sections of the document are presented on an electronic device. This value can also be manipulated to gradually accelerate or slow down the tempo of the presentation by computationally adding or subtracting from its value gradually between two points in the text. The operator can also add Imagery Files  6 , and Audio Files  7  to a document at this point and attach them to the appropriate place in the file. Using the Audio Editor function  521  and the Image Editor function  523  of the Author Interface  52 , the operator can attach tags to any word or cognitive cluster to act as a pointer to call up a file with performance instructions. The instructions could include length of time presented; whether or not the Imagery file  6  or Audio file  7  interrupts the flow of text; or, its opacity if an Imagery file, or volume if an Audio file. These tags are the fifth (Imagery Pointer  535 ) and sixth (Audio Pointer  536 ) tags. It may be that an author or editor will want certain words or sections of the document to be given more emphasis or special consideration. For this purpose, using Recognizability/Comprehensibility Editor  525  function of the Author Interface  52 , each of these tags (Recognizability  531  and Comprehensibility  532 ) can be edited on an individual word (or cognitive cluster), sentence, paragraph, or section basis of the document. The resulting Intelligently Tagged File  8  can then be used on the same machine or sent to other machines for presentation. 
   The Intelligently Tagged File  8  is next processed by the Objective Analysis Module  9  as depicted in  FIG. 4 , which may reside on the same computer or different digital device. This module  9  further processes values from the Intelligently Tagged File  8  in preparation for presentation. The Text Time Factor  95  is the first factor in the delivery of text for display and controls the length of time each word or cognitive cluster is displayed while in the Zero Eye Movement (ZEM) mode. It is the result of the processing by the Blending Distillation Engine  93  of both the Recognition value  91  and the Comprehensibility value  92  along with the Tempo value  97  (if available). The proportional weight given to these values in calculating the Text Time Factor  95  is set by using the Text Time Control  941  of the Property Editor  94 . Since this value is used to set the length of time words or cognitive clusters are displayed according to the need of the reader to process them, there may be a great difference in preferences between users as to which value should be given greatest weight. For instance, a person with a mild case of dyslexia may want to give more weight to those words which have a high recognizability value, while a person who has a limited vocabulary might prefer the opposite. 
   The second factor is Text Color Factor  96  and it indicates what color property is assigned to each word or cognitive cluster based upon its part of speech. It can be used either to print on paper, or for either standard or Zero Eye Movement (ZEM) display on an electronic display device. The color is assigned by the Text Color Control  942  of the Property Control Editor  94  through the Blending Engine  93  which uses the Part of Speech value  98  and a user modifiable Preference File  993  for determining the color to assign. 
   The third factor is the Text Opacity Factor  99 . It varies the amount of opacity which is used to display a word or cognitive cluster to indicate importance. By using increased opacity for important or difficult words, increased attention can be given to them by the reader. It can be used either to print on paper, or used for either standard or Zero Eye Movement (ZEM) display on an electronic display device. The Text Opacity property  996  is assigned through the Blending Engine  93  and is also the result of processing both the Recognition Value  91  and the Comprehensibility Value  92  with control of the weighting of each value being provided by the Text Opacity Control  943  of the Property Control Editor  94 . The weighting may be the same or different from that used to control display time. 
   The author can modify Appearance properties  997  with the Appearance Control  944  of the Property Editor  94  through the Reduction Engine  991 . With this editor  94  the author can edit the color or pattern of the background, and choose the size and typeface in which the text is to be displayed. 
   The author can modify Image properties  998  with the Imagery Control  945  of the Property Editor  94  through the Reduction Engine  991 . With this editor  94  the author can edit the opacity of images. 
   The author can also modify Audio Element  999  through the Audio Control  946  of the Property Editor  94 . With the editor  94  the author can edit the volume and the tone qualities of the audio. 
   Since some presentation devices such as pagers or cell phones are incapable of using all the presentation techniques available to more powerful machines a process is provided for combining properties such as the Recognizability  91 , Comprehensibility  92 . and Tempo  97  values into one value and leaving out the rest of the values entirely which allows the presenting device to display the words in a more easily comprehendible manner with reduced bandwidth. This is accomplished through the Reduction Engine  991  which is controlled by the Device Accommodation Editor  992 . This results in the creation of a Property Deliverable File  10 . 
   The resulting Property Deliverable File  10  is then processed through the Delivery Display Module  11  depicted in  FIG. 5 . It is first processed by the Display Engine  111  of the Delivery Display Module  11  to either print the document with the addition of the coloring of the parts of speech and the use of varying opacity for emphasis, or for display on an electronic device with the previously mentioned properties or by using the automated flow method Zero Eye Movement. The Delivery Selector  112  is used to select the method of output. When used for printing, the Text Color Hue property  1151  can be used to print different colors indicative of each part of speech. Studies have shown that such differentiation can increase reading comprehension. Also, words or cognitive clusters that are valued more highly can be printed with the highest opacity while those which are valued as less important can be printed less opaquely. 
   An important and useful purpose for this system is for use on electronic display devices using the technique often referred to as “zero eye movement” (ZEM) or “rapid serial visual presentation” (RSVP). This technique rapidly flashes words or small groups of words on the screen at a user controllable speed. Compensation has been given for difficulty in reading longer words by slowing the presentation, and pauses have been given at the end of phrases and sentences according to punctuation within other methods of ZEM however, neither recognizability nor comprehension factors have been considered. Through the Refined File&#39;s Text Display Time property  1161  (derived from the previously described analysis processes), control of the display time for each word is provided in such a way as to display the words in a rhythm more closely matched to that at which a reader might normally adopt if reading in the traditional manner. 
   Using the Delivery and Display Module  11  as depicted in  FIG. 5 , the user can both control the presentation in real time and customize certain aspects of the presentation. It is through the User Control&#39;s  114  Flow Control  1141  that the user controls sets the Text Display Time  1161  starting, pausing, and stopping the presentation, speeding and slowing the presentation in real time, and controlling the length of time graphics, video or audio presentation, if not previously defined. User Control  114  also is used for rereading a sentence, paragraph or section of the document. The user can also set the starting speed, set a speed increase over a defined period of time or number of words (acceleration), set the difference in display time between the shortest and longest lengths of display (compression), and set a minimum value for a word to be displayed (exclusion). This control also enables the user to view only sections of the document which have been previously marked using the Mark Up Control  1142 . 
   Through the Mark Up Control  1142  the user can hold down a key while viewing a section of a document and mark it for future reference. The section that is marked can then be displayed with a different colored background than otherwise and will be uniquely selectable for independent display or copying for other use. 
   The Appearance Control  1143  enables the user to determine the color saturation and the color of the background both for the normal text and for text that has been highlighted for the Text Color Hue  1162 . It also allows the user to vary the font, size, and background. 
   The Audio Control  1144  is used to control volume. 
   The Imagery Control  1145  is used to control whether graphics will be displayed, and to choose the size and opacity of the graphic or video. 
   While the invention is described with reference to the structures and processes disclosed, it is not confined to the details set forth, but is intended to cover such modifications or changes as may fall within the scope of the following claims.