Patent ID: 7031910
Filing Date: 2006-04-18
Classification: G06F

Abstract:
1. Method of encoding linguistic frequency data, the method comprising: mapping each character string occurring in a source text to a numeric identifier identifying the character string, identifying a plurality of sets of n character strings in a source text, n being an integer number greater than 1, each set forming an n-gram comprising at least a first and a second successive character string, for each set, obtaining frequency data indicative of the frequency of the respective set in the source text, creating a memory array f for containing the frequency data, n−1 pointer memory arrays p for each character string that is a first character string in at least one of the sets, assigning a memory position in memory array f to the respective character string and storing at said memory position the frequency data of each set comprising the respective character string as the first character string, grouping the frequencies relating to n-grams that have the same first character string into a block within the array f, for each character string that is a second character string in at least one of the sets, assigning a memory position in pointer memory array p grouping the pointers relating to n-grams that have the same second character string together as a block within the pointer memory array p storing an offset position for each respective first character string in positional array r storing an offset position for each respective i