Patent ID: 11929901
Assignee: SALESFORCE, INC.
Field: Digital communication (Electrical engineering)
Classification: CPC H | IPC H

Claim 6:
7. A distributed data processing system comprising:
one or more processors configured to implement a pipeline engine of a pipeline architecture and a network adapter; and
a memory device coupled to the one or more processors, the memory device having instructions stored thereon that, in response to execution by the one or more processors, cause the one or more processors to:
receive, by the pipeline engine from the network adapter, a dispatch request for executing a user-defined pipeline, wherein the dispatch request is agnostic to an underlying network infrastructure by which the user-defined pipeline is executed;
compute a performance metric based on the dispatch request and by information extracted from metadata associated with messages exchanged between computational nodes of the pipeline architecture, the performance metric comprising at least an estimate of computational times for local execution;
execute one or more stages of the user-defined pipeline locally by the pipeline engine based on a user-specified requirement, wherein the user-specified requirement overrides decision logic of the pipeline engine in determining whether to execute the stages of the user-defined pipeline locally by the pipeline engine or transmit the dispatch request back to the network adapter; and
determine, based at least partially on the performance metric and an overhead generated through serialization and deserialization of transmitting the dispatch request back to the network adapter, whether to execute the remaining stages of the user-defined pipeline locally by the pipeline engine or transmit the dispatch request back to the network adapter, wherein transmitting the dispatch request requires serialization and deserialization of the dispatch request.