It is released after front/backbuffers (XBMCRenderManager::NotifyDisplayFlip) have been flipped. This is the time we know the displayed buffer is ready for reuse. It's the most efficient use of the buffers.