Patent ID: 7930432

Claim:
An automated processor-implemented method for automatically distributing a workplan for a data flow execution (DFE), said DFE comprising a chain of transforms having at least one chain of distributable transforms, said automated method comprising: automatically translating and optimizing, via the processor, a graph describing a desired data flow into the chain of transforms; automatically distinguishing non-distributable and distributable transforms in the chain of transforms including the at least one chain of distributable transforms; automatically scaling the chain of transforms for execution by: automatically adding to the chain of transforms at least one replica of said at least one chain of distributable transforms; automatically adding to the chain of transforms a distributor immediately upstream from, and coupled to, said at least one chain of distributable transforms and said at least one replica of said at least one chain of distributable transforms; and automatically adding to the chain of transforms a collector immediately downstream from, and coupled to, said at least one chain of distributable transforms and said at least one replica of said at least one chain of distributable transforms.