Patent ID: 6304601
Filing Date: 2001-10-16
Classification: H03M,Y10S

Abstract:
Apparatus for compressing text comprising:means for splitting a main character string into component strings;means for counting the frequency of occurrence of each component string in the main character string and ordering the component strings in their frequency of occurrence;first allocating means for allocating to each component string a token value representative of the component string and determined by the frequency of occurrence of the component string;means for storing the token value so allocated as a token table;second allocating means for allocating to each component string in the main character string the token value for that component string from the token table to generate a sequence of token values representing the main character string in a compressed format; andmeans for storing the sequence of token values,wherein the splitting means in operation splits the main character string in accordance with a splitting algorithm into first and second sets of component strings, the first set comprising strings of multiple spaces and the second set comprising the remainder of the main character string which comprises non-multiple spaced strings which include words, single spaces and punctuation so that tokens representing single spaces are discarded, the second allocating means tokenises each combination, in the text, of a single space and a punctuation mark as a component string, and wherein the splitting algorithm and the second allocating means thereby enable the original document to be reconstituted faithfully including the single spaces which have effectively been discarded in the splitting process.