vdpau knows nothing about the fence. the idea is that the buffer is moved from the rendered queue back to free queue after the fence has signaled. At this time the surface flows back to vdpau.