Don't unref the stream more than once.