Only use direct submit on decoders that have (effectively) infinite input buffers