tokens: A very successful method called Temporal Ensembling was also recently introduced , where the authors explored the idea of a temporal ensembling network for semi - supervised learning where the predictions of multiple previous network evaluations were aggregated using an exponential moving average ( EMA ) with a penalization term for the predictions that were inconsistent with this target , achieving state - of - the - art results in several semi - supervised learning benchmarks .