Patent ID: 9009139
Filing Date: 2015-04-14
Classification: G06F

Abstract:
1. A method of generating a query pipeline in a logging system comprising: parsing received log data into data chunks; storing the data chunks in a storage; generating metadata of the data chunks stored in the storage and storing the metadata in a database; receiving a query request; determining query operations based on the query request; creating, by a processor, a query pipeline including the query operations based on the query request, wherein the query operations include a first query operator and a second query operator to perform a first query operation and a second query operation, wherein a result from the first query operation in the query pipeline is fed to the second query operation in the query pipeline; identifying a username in the query request to determine a level of access of a user; modifying the query pipeline, including adding a new operator between the first query operator and the second query operator to limit results from the query pipeline based on the determined level of access of the user; optimizing, by the processor, the modified query pipeline including at least one of: rearranging the query operators in the query pipeline, eliminating an operator from the query pipeline, or combining multiple operators in the query pipeline into a single operator; and processing the query operations in the optimized query pipeline to obtain query results from the metadata in the database and the data chunks in the storage.