Patent ID: 8473948

Claim:
A method for synchronizing a plurality of cooperative thread arrays (CTAs) executing an algorithm within a parallel processing system, the method comprising: for a first plurality of threads within each CTA of the plurality of CTAs, performing a first set of computations associated with a first pass of the algorithm; for each CTA in the plurality of CTAs, performing a thread synchronization operation across the first plurality of threads with the CTA to ensure that all threads within the first plurality of threads within the CTA have completed the first set of computations; for each CTA in the plurality of CTAs, performing an atomic add operation via a first thread within the CTA to increment a first semaphore to indicate that all threads within the first plurality of threads within the CTA have completed the first set of computations; and for each CTA in the plurality of CTAs, performing a semaphore wait operation to ensure that each CTA within the plurality of CTAs has completed the first set of computations.