Small performance optimization by only blocking on an input buffer if we've already got a DU