Distributed computing apparatus, comprising a first and a second distributed computing system, each comprising: a primary and a secondary input/output (I/O) switch module (150, 155) responsive to a command to transmit data to a location external to the distributed computing system, each input/output (I/O) switch module comprising an external I/O interface and a plurality of communications modules configured to transmit and receive data on a plurality of channels; a plurality of nodes each comprising a plurality of communications modules and one or more of a memory module, a processing module, or an input/output (I/O) module, wherein each of the communications modules are coupled to transmit and receive data to and from at least two other nodes and at least one of the I/O switch modules, wherein the apparatus is configured to: send data to the first I/O switch module to transmit data to a location external to the distributed computing apparatus; and in the result of a failure of the first I/O switch module, send data to the second I/O switch module to transmit data to a location external to the distributed computing apparatus, wherein: the primary I/O switch module of the first distributed computing system is communicatively coupled via a high-bandwidth interconnection to the primary I/O switch module of the second distributed computing system; and the secondary I/O switch module of the first distributed computing system is communicatively coupled via a high-bandwidth interconnection to the secondary I/O switch module of the second distributed computing system. a primary and a secondary input/output (I/O) switch module (150, 155) responsive to a command to transmit data to a location external to the distributed computing system, each input/output (I/O) switch module comprising an external I/O interface and a plurality of communications modules configured to transmit and receive data on a plurality of channels; a plurality of nodes each comprising a plurality of communications modules and one or more of a memory module, a processing module, or an input/output (I/O) module, wherein each of the communications modules are coupled to transmit and receive data to and from at least two other nodes and at least one of the I/O switch modules, wherein the apparatus is configured to: send data to the first I/O switch module to transmit data to a location external to the distributed computing apparatus; and in the result of a failure of the first I/O switch module, send data to the second I/O switch module to transmit data to a location external to the distributed computing apparatus, send data to the first I/O switch module to transmit data to a location external to the distributed computing apparatus; and in the result of a failure of the first I/O switch module, send data to the second I/O switch module to transmit data to a location external to the distributed computing apparatus, the primary I/O switch module of the first distributed computing system is communicatively coupled via a high-bandwidth interconnection to the primary I/O switch module of the second distributed computing system; and the secondary I/O switch module of the first distributed computing system is communicatively coupled via a high-bandwidth interconnection to the secondary I/O switch module of the second distributed computing system.