An accelerator device comprising: at least one slot (1630, 1632), the at least one slot configured to implement a kernel (1660, 1662); and a circuitry (1640, 1642) in the at least one slot, which is configured to enable the kernel to cooperatively execute workloads with at least another accelerator device to: receive, from a processor of a compute device, an instruction to automatically copy one or more parameters of a workload to one or more remote accelerator devices (1622, 1624) in response to receipt of the one or more parameters, the workload to be cooperatively performed by the slot of the accelerator device and one or more slots of the one or more remote accelerator devices; receive, from the processor of the compute device, the one or more parameters of the workload; obtain availability data indicative of the availability of the one or more remote accelerator devices; and automatically send, in response to receipt of the one or more parameters of the workload, the one or more parameters of the workload to the one or more remote accelerator devices over a logical communication path established, based on the obtained availability data, between the accelerator device and the one or more remote accelerator devices, wherein the logical communication path is a shortest path established based on at least one of determining: (i) the logical communication path has the lowest latency; (ii) the logical communication path is arranged with the lowest number of intermediary devices between the accelerator device and the one or more remote accelerator devices; (iii) the logical communication path has the least amount of congestion; and (iv) the logical communication path is formed from multiple physical communication paths based on target quality of service parameters received in association with the instruction. at least one slot (1630, 1632), the at least one slot configured to implement a kernel (1660, 1662); and a circuitry (1640, 1642) in the at least one slot, which is configured to enable the kernel to cooperatively execute workloads with at least another accelerator device to: receive, from a processor of a compute device, an instruction to automatically copy one or more parameters of a workload to one or more remote accelerator devices (1622, 1624) in response to receipt of the one or more parameters, the workload to be cooperatively performed by the slot of the accelerator device and one or more slots of the one or more remote accelerator devices; receive, from the processor of the compute device, the one or more parameters of the workload; obtain availability data indicative of the availability of the one or more remote accelerator devices; and automatically send, in response to receipt of the one or more parameters of the workload, the one or more parameters of the workload to the one or more remote accelerator devices over a logical communication path established, based on the obtained availability data, between the accelerator device and the one or more remote accelerator devices, wherein the logical communication path is a shortest path established based on at least one of determining: (i) the logical communication path has the lowest latency; (ii) the logical communication path is arranged with the lowest number of intermediary devices between the accelerator device and the one or more remote accelerator devices; (iii) the logical communication path has the least amount of congestion; and (iv) the logical communication path is formed from multiple physical communication paths based on target quality of service parameters received in association with the instruction. receive, from a processor of a compute device, an instruction to automatically copy one or more parameters of a workload to one or more remote accelerator devices (1622, 1624) in response to receipt of the one or more parameters, the workload to be cooperatively performed by the slot of the accelerator device and one or more slots of the one or more remote accelerator devices; receive, from the processor of the compute device, the one or more parameters of the workload; obtain availability data indicative of the availability of the one or more remote accelerator devices; and automatically send, in response to receipt of the one or more parameters of the workload, the one or more parameters of the workload to the one or more remote accelerator devices over a logical communication path established, based on the obtained availability data, between the accelerator device and the one or more remote accelerator devices, wherein the logical communication path is a shortest path established based on at least one of determining: (i) the logical communication path has the lowest latency; (ii) the logical communication path is arranged with the lowest number of intermediary devices between the accelerator device and the one or more remote accelerator devices; (iii) the logical communication path has the least amount of congestion; and (iv) the logical communication path is formed from multiple physical communication paths based on target quality of service parameters received in association with the instruction. (i) the logical communication path has the lowest latency; (ii) the logical communication path is arranged with the lowest number of intermediary devices between the accelerator device and the one or more remote accelerator devices; (iii) the logical communication path has the least amount of congestion; and (iv) the logical communication path is formed from multiple physical communication paths based on target quality of service parameters received in association with the instruction.