A method for processing data in a data processing system using compiled dataflow graphs stored in a data storage system , the data processing system including an input device or port and an execution environment , the execution environment including a pre-execution module and an execution module , and the method including: receiving, by the input device or port, multiple units of work that each include one or more work elements; and processing, by the execution environment , a first unit of work using a first compiled dataflow graph loaded into the data processing system in response to receiving the first unit of work, the first compiled dataflow graph having been compiled into one or more data structures representing a first dataflow graph that includes nodes representing data processing components connected by links representing flows of work elements between data processing components, the processing including analyzing, by the pre-execution module , the first unit of work to determine a characteristic of the first unit of work; identifying, by the pre-execution module , one or more compiled dataflow graphs from multiple compiled dataflow graphs stored in the data storage system that include at least some compiled dataflow graphs that were compiled, before the first unit of work was received, for processing a unit of work having the determined characteristic of the first unit of work; loading, by the pre-execution module , one of the identified one or more compiled dataflow graphs into the data processing system as the first compiled dataflow graph , wherein the loading includes loading the one of the identified one or more compiled dataflow graphs into a running container graph that is executed by the execution module ; and generating, by the execution module , one or more output work elements from at least one work element in the first unit of work using the first dataflow graph . receiving, by the input device or port, multiple units of work that each include one or more work elements; and processing, by the execution environment , a first unit of work using a first compiled dataflow graph loaded into the data processing system in response to receiving the first unit of work, the first compiled dataflow graph having been compiled into one or more data structures representing a first dataflow graph that includes nodes representing data processing components connected by links representing flows of work elements between data processing components, the processing including analyzing, by the pre-execution module , the first unit of work to determine a characteristic of the first unit of work; identifying, by the pre-execution module , one or more compiled dataflow graphs from multiple compiled dataflow graphs stored in the data storage system that include at least some compiled dataflow graphs that were compiled, before the first unit of work was received, for processing a unit of work having the determined characteristic of the first unit of work; loading, by the pre-execution module , one of the identified one or more compiled dataflow graphs into the data processing system as the first compiled dataflow graph , wherein the loading includes loading the one of the identified one or more compiled dataflow graphs into a running container graph that is executed by the execution module ; and generating, by the execution module , one or more output work elements from at least one work element in the first unit of work using the first dataflow graph . <EOS>