Keep track of streams that we open from our side.