Defer demuxer pause until buffers full