Patent ID: 7627567
Filing Date: 2009-12-01
Classification: G06F,Y10S

Abstract:
1. A process to evaluate an input string to segment said string into component parts comprising: providing a state transition model derived from training data from an existing collection of data records that includes probabilities to segment input strings into component parts, wherein the training data corresponding to database attributes in the existing collection of data records does not comprise manually segmented training data, and the state transition model categorizes tokens in database attribute values of the data records into positions based on a fixed beginning, middle, and trailing token topology that: determining a most probable segmentation of the input string by comparing tokens that make up the input string with the state transition model derived from the existing collection of data records; segmenting the input string into one or more component parts according to the most probable segmentation; and storing the one or more component parts in a database on a computer system.