Patent ID: 9542426
Date: 2017-01-10
CPC Classifications: G06F

Claim:
1. A method, performed at least partly by a device, for processing data in an in-memory processing system that obtains the data from its memory of a first size for the processing of the data, wherein the data has a size that is larger than the first size of the memory of the in-memory processing system, and wherein the method comprises: storing a first portion and a second portion of the data in the memory of the in-memory processing system for processing by the in-memory processing system; wherein the storing of the second portion of the data stores the second portion of the data in the memory of the in-memory processing system for processing by the in-memory processing system before the in-memory processing system completes the processing of the first portion of the data, thereby allowing the in-memory processing system to process the second portion of the data when the processing system is able to process the second portion of the data; generating an execution plan for the processing data by the in-memory processing system, wherein the execution plan includes at least one pipeline-enabled component; storing, by the at least one pipeline-enabled component, the first portion of the data in the memory of the in-memory processing system for processing by the in-memory processing system; and storing, by the at least one pipeline-enabled component, a second portion of the data in the memory of the in-memory processing system for processing by the in-memory processing system before the in-memory processing system completes the processing of the first portion of the data; generating at least one pipelined-aware execution plan component in the execution plan, wherein the pipelined-aware component is configured to interact with the at least one pipeline-enabled component so that the pipeline-enabled execution plan component can effectively determine, at runtime when the execution plan is executed, to store at least one of the first and second portions of the data in-memory processing system for processing by the in-memory processing system; wherein the pipelined-aware execution plan component is configured to cause generation of a runtime pipeline operator configured to operate at runtime to allow the in-memory processing system to process data in a pipelined manner; and wherein the runtime pipeline operator includes one or more instances of a scanning runtime operator configured to scan the data.