Only rewind a stream if necessary