Patent ID: 9588980
Date: 2017-03-07
CPC Classifications: G06F

Claim:
1. A method for real-time identification of data candidates for data processing by a processor device in a distributed computing environment, the method comprising: sampling data candidates for performing a classification-based compression upon the data candidates; computing a heuristic on a randomly selected data sample from the data candidate, the heuristic computed by: summing a ratio between the actual number of the characters and the expected number of the characters, and then dividing the ratio by a number of the data classes that are not empty, wherein the non-classifiable data are included in the number of the data classes during the dividing, and the number of the data classes, that are not empty, have characters that belong to the class that were observed in the input; and performing the classification-based compression on the data candidates if the ratio exceeds a threshold.