Patent ID: 9639577
Date: 2017-05-02
CPC Classifications: G06F

Claim:
1. A computer-implemented method for scanning data, the method comprising: storing Golomb-Compressed Sequence (GCS) pre-filter data in a random-access memory; storing a GCS pre-filter index to the GCS pre-filter data in the random-access memory; storing GCS data on a non-transitory storage drive; storing a GCS index to the GCS data in the random-access memory; scanning at least a portion of data associated with a file to determine whether any portion of the scanned data matches contents of the GCS pre-filter data or GCS data; generating a plurality of hashes from the scanned data; sorting the plurality of hashes of the scanned data; deduplicating the sorted plurality of hashes; querying the pre-filter index with the plurality of sorted and deduplicated hashes to determine whether the GCS pre-filter data is associated with the scanned data; upon determining the GCS pre-filter data is associated with the scanned data: upon determining at least one of the sorted and deduplicated hashes is not associated with the GCS pre-filter data, querying the GCS index with the at least one sorted and deduplicated hash not associated with the GCS pre-filter data to determine whether the GCS data is associated with the scanned data; upon determining the GCS data is associated with the scanned data: upon determining at least one of the sorted and deduplicated hashes is not associated with the GCS pre-filter data or the GCS data: upon determining data in the database is associated with the scanned data: