A method for providing interruption handling among a plurality of instances of a concurrent computing process, the method comprising the steps of: - declaring a task on a client computing device of a plurality of computing devices, the task defining a technical computing command to be executed and the number of arguments and any input data to the arguments; - launching the plurality of instances of the concurrent computing process on the plurality of computing devices, wherein the plurality of instances include a first instance and a second instance; - establishing a communication channel for communication among the plurality of instances thereby forming a collaboration to execute a computational job, wherein the communication channel includes a Message Passing Interface communication channel, wherein a first Message Passing Interface Communicator to send and receive control messages and a second Message Passing Interface Communicator to send and receive control data are established; - executing the computational job concurrently on the plurality of instances; - detecting an interrupt request on one of the plurality of instances, wherein the interrupt request is sent from a user instructing the termination of the execution of the computational job, or the interrupt request is caused by an error occurred in the concurrent computing process, or the interrupt request is caused by an error occurred in the communication channel; and - terminating the execution of the computational job while maintaining the communication among the plurality of instances established by the communication channel, wherein an interrupt message is sent to the other instances via the first Message Passing Interface Communicator to propagate the interrupt request to the other instances. - declaring a task on a client computing device of a plurality of computing devices, the task defining a technical computing command to be executed and the number of arguments and any input data to the arguments; - launching the plurality of instances of the concurrent computing process on the plurality of computing devices, wherein the plurality of instances include a first instance and a second instance; - establishing a communication channel for communication among the plurality of instances thereby forming a collaboration to execute a computational job, wherein the communication channel includes a Message Passing Interface communication channel, wherein a first Message Passing Interface Communicator to send and receive control messages and a second Message Passing Interface Communicator to send and receive control data are established; - executing the computational job concurrently on the plurality of instances; - detecting an interrupt request on one of the plurality of instances, wherein the interrupt request is sent from a user instructing the termination of the execution of the computational job, or the interrupt request is caused by an error occurred in the concurrent computing process, or the interrupt request is caused by an error occurred in the communication channel; and - terminating the execution of the computational job while maintaining the communication among the plurality of instances established by the communication channel, wherein an interrupt message is sent to the other instances via the first Message Passing Interface Communicator to propagate the interrupt request to the other instances.