Fence should be set when we discard a buffer, not after render. It may very well be re-used again. So we need to know that it's not in use anymore and setup a fence.