Patent ID: 11921672
Assignee: SPLUNK INC.
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 28:
29. A computing system of a data intake and query system, the computing system comprising:
memory; and
one or more processing devices coupled to the memory and configured to:
receive a query that references a remote data store that stores raw machine data and non raw machine data, wherein the remote data store is one of a plurality of remote data stores that are external to and separate from the data intake and query system;
access storage deployment data at a configuration file to identify directories and a plurality of file types that are configured to store the raw machine data and that are to be accessed in the remote data store, wherein the remote data store stores heterogeneous data in files having different file types, and wherein the configuration file stores the storage deployment data for the plurality of remote data stores;
allocate a plurality of processors to communicate with the remote data store;
generate instructions for worker nodes, wherein the generated instructions include instructions to:
scan, using the plurality of processors, the identified directories to identify whether the identified directories include files configured to store the raw machine data;
open, using a processor of the plurality of processors, a file in the remote data store, the file having a file type of the plurality of file types identified in the configuration file, wherein the file type corresponds to files that include raw machine data;
apply, using the processor, filter criteria to content of the file; and
include, using the processor, data from the file that satisfies the filter criteria in a partition, wherein the plurality of processors concurrently process a plurality of partitions including the partition, and wherein each partition comprises data from one or more files of the remote data store; and

execute the query based on the generated instructions to identify raw machine data from one or more remote data stores that satisfy the query.