Patent ID: 7987161

Claim:
A computer-implemented method of compressing data, the method comprising: receiving a data set in a data stream, the data set including a set of data descriptor fields; partitioning the data set into one or more data subsets using the set of data descriptor fields; generating one or more tabular slices and an index for at least one of the data subsets using the set of data descriptor fields, the one or more tabular slices being identified by the index; mapping the one or more tabular slices to a compressed data block using a many-to-one mapping algorithm; compressing the one or more tabular slices into the compressed data block by a data compression scheme using a hardware compressor; generating a compression data file in a database, the compression data file having a header that stores information about the data compression scheme; storing the compressed data block in the compression data file; generating a translation map file that associates the one or more tabular slices and the compressed data block of the compression data file; and storing the translation map file in the database.