Patent ID: 8515918

Claim:
A method of measuring information content in at least one data stream including one or more data segments, the method comprising: providing a library; processing at least one data stream including one or more data segments based on a specification to obtain possible message or data fields, the fields including token and contextual information; populating the library dynamically with entries representing the possible message or data fields, the entries including token and contextual information; processing at least one new data segment based on a specification to obtain new message or data fields, the new fields including new token and contextual information; comparing the new message or data fields from the at least one new data segment with the entries in the populated library to identify substrings of the new message or data field tokens that are present in the library and match an expected context; measuring or computing a compressed size of the at least one new data segment based on the step of comparing and discounting bits representing the substrings of the at least one new data segment present in the library from bits representing the at least one new data segment to obtain a measurement of the information content in the data stream; identifying measurements exceeding a threshold based on an expected value of the measurements of information content in the data stream; and indicating an undesirable information flow based on the identifying.