Patent ID: 11922237
Assignee: MELLANOX TECHNOLOGIES, LTD.
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 0:
1. A method for collective communications, comprising:
invoking a collective operation over a group of computing processes in which the processes in the group concurrently transmit and receive data to and from other processes in the group via a communication medium;
composing, for transmission by source processes in the group, messages comprising metadata indicating how the data to be transmitted by the source processes in the collective operation are to be handled by destination processes that are to receive the data and also comprising in at least some of the messages the data to be transmitted by one or more of the source processes to one or more of the destination processes,
such that when a size of the data for transmission from a given source process to a given destination process is less than a predefined threshold, the data is incorporated together with the metadata in a message from the given source process to the given destination process, and when the size of the data for transmission from the given source process to the given destination process is greater than the predefined threshold, the message contains only the metadata without the data;
transmitting the composed messages concurrently from the source processes to the destination processes in the group over the communication medium; and
processing the data by the destination processes in response to the metadata comprised in the messages received by the destination processes, wherein when a given message contains the metadata without the data, the destination process retrieves the data from the source process using the metadata in the given message.