Patent ID: 8572615

Claim:
A parallel computing system including a plurality of nodes each provided with a synchronization device that establishes synchronization by awaiting incoming data and transmitting the data when all awaited data is received, each synchronization device comprising: a receiver that receives data from at least two synchronization devices establishing synchronization, and extracts synchronization information and register selection information from the received data, the register selection information indicating one of the first synchronization and second synchronization; a transmitter that transmits data to each of the at least two synchronization devices from among a plurality of synchronization devices; a first receiving state register that stores the extracted synchronization information of the first synchronization; a second receiving state register that stores the extracted synchronization information of the second synchronization; and a controller that stores the extracted synchronization information into the first receiving state register and the second receiving state register alternately based on the register selection information, and controls the transmitter to transmit data including the register selection information to each of the at least two synchronization devices when the extracted synchronization information is stored in one of the first receiving state register and the second receiving state register.