allow incremental input for pipeline parallelism