Venue: NeurIPS 2022 Conference

Reviews:

final_score: rating: 6: Weak Accept: Technically solid, moderate-to-high impact paper, with no major concerns with respect to evaluation, resources, reproducibility, ethical considerations.
review_content: summary: This paper introduces a novel extension of the mean-teacher method for semi-supervised learning. Rather than only using previous knowledge, this framework looks ahead to involve the future information to update the teacher model, which improves the quality of pseudo labels to mitigate the confirmation bias issue. Authors also propose different variants, like improved-FST, FST-D and FST-W. Comprehensive experiments demonstrate the effectiveness of the proposed pipeline. 

strengths_and_weaknesses: - This paper presents a novel framework that extends prevailing mean-teacher method by learning from the future. The paper is technically sound. Different variants are also designed. 
- Authors conducted extensive experiments for various tasks, like semi-supervised semantic segmentation and domain adaptation. The results on different datasets show the effectiveness of the introduced pipeline.
- The paper is well-written and well-organized. It provides enough information for reproduction. 
- For the implementation, some parts are not clear. There are some questions posed in the questions part below. 


questions: - The improved-FST is proposed since Eq(3) discards the contribution of the student weight at time t (line 153). If we let the teacher model equal to the student model at the very beginning (time t=0) and evolve the training following the EMA in equation(1), I wonder if, in this case, it could already involve the current student weights information? It may simply the computation a little. Correct me if I am wrong. 
- I am not very clear about the implementation of FST-D. Do we update the student weights when looking ahead K steps? For instance, let’s say K=3, we are looking 3 steps ahead (t+1, t+2, t+3). When we acquire the gradients at time=t+1, do we update the student model with these gradients, and then update the teacher model? If we update it, as shown in equation(5), it actually increases the number of updates to the student model(maybe another student model, but the cost of the update increases). However, in line 334, it says the number of updates remains the same. Also, in line 336, it says that it trades space for time). Even if we maintain only one ahead student model, for each time t, the original student model is updated, and we need to run this ahead student model over the next 3 steps to provide future information. In this case, I am curious about why it saves time? I am not sure whether I understand it accurately, it would be better if the authors clarify these questions. 

Typo: 
- Line 296: ‘of’ appears twice

limitations: Limitations and potential social impacts have been discussed in this work.
review_title: null

final_score: rating: 5: Borderline accept: Technically solid paper where reasons to accept outweigh reasons to reject, e.g., limited evaluation. Please use sparingly.
review_content: summary: In this paper, the authors suggest a simple and interesting modification to the student-teacher self-training technique, where instead of having an exponential moving average teacher that is only reflecting the past states of the student model, they base it on a future hypothetical state of the model to prevent the confirmation bias on lower quality pseudo labels. This is achieved by one of the two variations that the authors suggest, referred to as deep future and wide future by either keeping a copy of the student model that is updated for multiple iterations over which the teacher model is updated as a moving average or by ensembling multiple updated student versions (with different data batches). The model is evaluated on unsupervised domain adaptations and semi-supervised learning and the empirical results show that the model improves as compared to the conventional teacher-student method.
strengths_and_weaknesses: Strengths:
* The paper aims to improve the student-teacher self-training scheme which is among the most frequently used semi-supervised techniques and therefore contributions here could be of interest to the community. 
* The empirical evaluations are fairly extensive. The method is compared against the baseline student-teacher model, state-of-the-art models in unsupervised domain adaptation, and multiple different variations in the ablation study. Besides, experimentations are also expanded to more modern baseline network architectures, making the conclusions more directly usable.
* The paper is reasonably well-written and easy to follow.

Weaknesses:
* Some of the figures and comparisons might be somewhat misleading. More specifically I am referring to figures 2, and 4(a) where an iteration-to-iteration comparison is done among the proposed futuristic and baseline student-teacher methods. Even though the authors argue (at the end of 4.4) that the comparisons are fair as the two models are getting the same number of updates for the student model, actually each iteration of updating the student model implies multiple updates to a copy of the student model ($g_\tilde{\theta}$), which is e.g. K times more compute-extensive in the deep-future version. This is specifically questionable when iteration-to-iteration comparisons are made. 
* As another note, but on a relevant topic, I like that the authors bring some comparisons between the proposed multi-iteration student-teacher model and models that are trained for longer. But I find it insufficient for proving wrong a major question/hesitation if a significant part of the advantage is coming from training for more; specifically, we observe that for both those two experiments the model's advantage is less visible (less than a percent) while the two models are computationally roughly equivalent and therefore fairer to compare. I would have liked to see more evidence against this question.
questions: As stated above a major question is if the suggested model consistently delivers better performance when compared to baseline models with an equal total number of gradient descent updates.
limitations: The major limitation, i.e. higher computational costs for training is discussed.
review_title: null

final_score: rating: 7: Accept: Technically solid paper, with high impact on at least one sub-area, or moderate-to-high impact on more than one areas, with good-to-excellent evaluation, resources, reproducibility, and no unaddressed ethical considerations.
review_content: summary: This paper presents a new self-training framework for semantic segmentation, by proposing the idea of "learning from future". Specifically, instead of using the current step to generate pseudo-labels and train the student, the teacher was updated with a virtual future student and supervised the following training accordingly. The proposed future-self-training (FST) framework was validated on the semantic segmentation task with extensive experimental analysis. The main contributions are the proposed FST framework and the experimental analysis.


**Post-rebuttal**

Thanks to the authors for their response and the additional experiments, which addressed most of my concerns. There are some remaining concerns I would suggest the authors address in their final version:

1) the motivation still sounds not that convincing to me, the "roughly better performance" itself as an observation does not sounds to be a convincing motivation; 
2) in the additional experiment of the newly introduced hyper-parameter, the result showed that the "learnable" setting performs much worse (58.87 vs. 59.81) than the "fixed" setting, which is not that convincing to me. Theoretically, if 0.999 is the "optimal" value, a learnable setting should be able to learn this value, instead of a way worse one. It would be better if the authors could provide an explanation for this in their revised version.

Otherwise, the paper is interesting and could be a good contribution to the community. As a result, I would keep my original positive rating.
strengths_and_weaknesses: **Strengths**

\+ The idea of using a "future student" to update the current teacher and then using this future teacher to supervise the current student for the self-training framework is interesting and could potentially inspire following-up research.

\+ The authors perform thorough ablation studies, in which each of the proposed components was well analyzed. This could be useful for following-up research to well leverage the design of the proposed method.

\+ The proposed method performs better than existing alternative methods for the unsupervised domain adaptation task.

\+ The paper is generally well-written and easy to follow.


**Weaknesses**

\- Although the idea of "learning from future" looks new, the motivation behind it is a bit unclear. Why learn from the future is beneficial, especially considering this "future" is also from the current state and the "history"? On the other hand, it also increases the ambiguity if the model (weights) is just cached without updating.

\- Please double-check if the variables were correctly labeled in Fig. 3. From the description, the teacher model  g_\phi was trained on labled data x_l and the student model on unlabeled data x_u. But what was shown in the figure is the other way around.
Please also add more details to the caption to make it self-contained.

\- In the proposed future self-training (FST), a new hyper-parameter \mu' was introduced, as in Eq. 4. But it was a bit unclear how to define this parameter and the necessity of it. The authors did an ablation study to test different \mu', but the result did not suggest a way to set it and it is also a bit unclear the significance of adding this additional parameter.
What if removing it or is that possible to change it to a learnable parameter?

\- Although the authors stated that the combination of FST-D and FST-W is more beyond the scope of their study, it would be better to have some preliminary investigation to see if these two types of learning schemes actually boost the learning.

\- It would be better to include more state-of-the-art methods for the experimental comparison of semi-supervised learning (Table 5).

\- L296, "... of of ..."
questions: It would be better if the authors could address the concerns raised above in the Weaknesses section. For example,

* A more convincing clarification on the motivation

* The necessity of the newly introduced hyper-parameter

* The authors' observation or comments on the combination of FST-D and FST-W

* Possibility of including more methods for the experimental comparison.

* notations in the figure.
limitations: The authors discussed the limitations of their work and acceptable solution to address it, but did not mention the potential negative societal impact.

A possible societal impact could be the bias within the learned model if there was also bias in the training data. The environmental impact could be another potential societal impact due to the large-scale and long-time training and the corresponding carbon emission.
review_title: null

Meta-review: metareview: This paper introduces an approach for reducing confirmation bias during self-training for semantic segmentation, by “learning from the future”, i.e. updating the teacher at a given timestep in self-training with a virtually updated version of the student, without actually using the gradients to update the student yet. Overall, reviewers were enthusiastic about the paper, finding the proposed method to be simple but interesting and of broad utility, and the paper well-written. The rebuttal responses seemed to address most questions and concerns, though there are some remaining weaknesses, such as the fact that the approach adds additional time/computation cost while the performance advantage versus standard self-training decreases with additional training iterations. However, on the balance I agree with reviewers that the strengths of the paper outweigh the weaknesses and recommend acceptance.
confidence: Certain
Decision: Accept