Patent ID: 11861331
Assignee: GOOGLE LLC
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 6:
7. A system comprising:
one or more processors; and
one or more computer storage media, the computer storage media comprising instructions that, when executed by the one or more processors, cause the one or more processors to perform operations, the operations comprising:
accessing, by one or more computers in communication with a distributed computing system, a parallel data collection class, wherein the parallel data collection class is configured to abstract away (i) details of how data is represented for the parallel data collection class and (ii) an implementation strategy for a set of parallel operations;
determining, by the one or more computers, an internal execution plan based on the set of parallel operations;
generating, by the one or more computers, a revised execution plan by integrating two or more parallel operations of the set of parallel operations together by:
applying one or more graph combination transformations that combine parallel operations of the set of parallel operations together into a smaller number of combined operations; or
applying one or more graph fusing transformations that fuse sequential parallel operations of the set of parallel operations together into a smaller number of fused operations;

determining, by the one or more computers, a total size of the set of parallel operations;
determining, by the one or more computers, whether the total size of the set of parallel operations satisfies a threshold;
when the total size of the set of parallel operations satisfies a threshold, executing, by the one or more computers, each parallel operation of the internal execution plan based on the implementation strategy; and
when the total size of the set of parallel operations fails to satisfy the threshold, causing, by the one or more computers, the distributed computing system to execute each parallel operation of the revised execution plan based on the implementation strategy.