Patent ID: 9239867
Filing Date: 2016-01-19
CPC Classification: G06F,G06Q

Claim Text:
1. A method for determining a variable role, the method comprising: determining, by a processor, a variable type, unique data value count values, and an overflow count value for a variable, wherein the unique data value count values include a number of occurrences of each of a plurality of unique data values for the variable in a data set, wherein the overflow count value is a number of occurrences of data values other than the plurality of unique data values for the variable in the data set; determining, by the processor, that the variable is a high cardinality variable when a number of the plurality of unique data values is greater than a value for a high cardinality threshold, or determining, by the processor, that the variable is not a high cardinality variable when a number of the plurality of unique data values is less than a value for a high cardinality threshold; when the variable is determined to not be the high cardinality variable, assigning, by the processor, a class variable role to the variable, or, when the variable is determined to be the high cardinality variable, determining, by the processor, whether or not the variable is a numeric variable type based on the determined variable type; when the variable is determined to not be the numeric variable type, comparing, by the processor, the overflow count value to the unique data value count values to determine whether or not rare visible values occurred for the variable; and when the determination is that rare visible values occurred for the variable, assigning, by the processor, a record identifier variable role to the variable.