Patent ID: 8179799

Claim:
A system for organizing network flow information, the system comprising: a data storage system comprising a raw data table, wherein the raw data table comprises flow records comprising data categories and a plurality of cluster identifiers; and a flow generating device configured to provide the flow records to the raw data table; and wherein one of said cluster identifiers is appended to each of said flow records, wherein each of said flow records comprises a time stamp, and wherein said cluster identifiers are produced according to timestamps such that each of the cluster identifiers identify different time periods; wherein the data storage system further comprises sub-tables configured to receive data from said raw data table, wherein each of said sub-tables is uniquely associated with one of the cluster identifiers, and wherein the raw data table is configured to be partitioned by moving each of the flow records into one said sub-tables associated with the cluster identifier appended to that flow record; a data analysis device configured to analyze a aggregated data tables, wherein said system is configured such that the flow generating device and the data analysis device operate concurrently.