Patent ID: 8755629
Filing Date: 2014-06-17
Classification: G06K

Abstract:
1. A computer-implemented method embodied in a non-transitory medium, said method configured to execute the computer-implemented steps of: a) reading in successive blocks of formatted text input having defined characters including letters and punctuation including spaces; b) examining a language unit in the text input of the current block, said language unit including a lexical unit, a sub-lexical unit or a subset of only punctuation including spaces; c) computing a plurality of information measures (IMs) selected from lexical, extra-lexical, sub-lexical and sub-character informativeness IMs for each character in the language unit; d) combining the plurality of IMs into a single combined information measure (CIM) for each said character indicating the predictability of that character to differentiate the language unit from other language units; e) repeating steps b through d for a plurality of language units in the current block; and f) outputting a list of CIMs for each character in the plurality of language units in the current block.