A distributed computing system, wherein the distributed computing system comprises a first computing node and a second computing node, a first graph data structure in the first computing node stores a name, a size, and a communication peer side identifier of a first data flow graph parameter in a first data flow graph, the first data flow graph parameter is a parameter carried by a connection edge of the first data flow graph, a second graph data structure in the second computing node stores the name, the size, and a communication peer side identifier of the first data flow graph parameter in a second data flow graph, the communication peer side identifier of the first data flow graph parameter in the first data flow graph corresponds to the second computing node, and the communication peer side identifier of the first data flow graph parameter in the second data flow graph corresponds to the first computing node; the first computing node is configured to generate a first triplet based on the name, the size, and the communication peer side identifier of the first data flow graph parameter in the first graph data structure according to a first interface parameter generation algorithm, wherein the first triplet comprises a message tag, a message size, and a destination process sequence number, the message tag corresponds to the name of the first data flow graph parameter, the message size corresponds to the size of the first data flow graph parameter, and the destination process sequence number is a sequence number of a process that is on the second computing node and that receives the first data flow graph parameter; the second computing node is configured to generate a second triplet based on the name, the size, and the communication peer side identifier of the first data flow graph parameter in the second graph data structure according to a second interface parameter generation algorithm, wherein the second interface parameter generation algorithm is the same as the first interface parameter generation algorithm, the second triplet comprises the message tag, the message size, and a source process sequence number, and the source process sequence number is a sequence number of a process that is on the first computing node and that sends the first data flow graph parameter; the first computing node is configured to invoke a message passing interface, MPI, sending primitive by using the first triplet as an interface parameter, to send the first data flow graph parameter to the second computing node; and the second computing node is configured to invoke an MPI receiving primitive based on the second triplet, to process the first data flow graph parameter. the first computing node is configured to generate a first triplet based on the name, the size, and the communication peer side identifier of the first data flow graph parameter in the first graph data structure according to a first interface parameter generation algorithm, wherein the first triplet comprises a message tag, a message size, and a destination process sequence number, the message tag corresponds to the name of the first data flow graph parameter, the message size corresponds to the size of the first data flow graph parameter, and the destination process sequence number is a sequence number of a process that is on the second computing node and that receives the first data flow graph parameter; the second computing node is configured to generate a second triplet based on the name, the size, and the communication peer side identifier of the first data flow graph parameter in the second graph data structure according to a second interface parameter generation algorithm, wherein the second interface parameter generation algorithm is the same as the first interface parameter generation algorithm, the second triplet comprises the message tag, the message size, and a source process sequence number, and the source process sequence number is a sequence number of a process that is on the first computing node and that sends the first data flow graph parameter; the first computing node is configured to invoke a message passing interface, MPI, sending primitive by using the first triplet as an interface parameter, to send the first data flow graph parameter to the second computing node; and the second computing node is configured to invoke an MPI receiving primitive based on the second triplet, to process the first data flow graph parameter.