Patent ID: 6584456
Filing Date: 2003-06-24
Classification: G06F,G06K,G06N

Abstract:
A computer-based method for optimal clustering of data, said data retained with computer storage, said method comprising the steps:tokenizing a data set; identifying unique tokens in said tokenized data set; performing distributional clustering of said unique tokens to reduce noise and useful search space and identifying one or more subsets of said unique tokens; selecting said identified one or more subsets and calculating an objective function value for each of said selected subsets, said calculation based upon varying number of clusters over a predetermined range, and for each number of clusters, cluster said data by a clustering algorithm to form data clusters; choosing among said subsets the one that maximizes said objective function value, and wherein an optimal model for clustering said data is obtained by simultaneously determining optimal values for: the number of clusters, the token subset, and the data clusters, whereby said optimal values taken together, maximizes said objective function value.