Don't memcpy IntermediateBuffer into final output buffer every frame
- decreases latency