Before revision:  In addition, we show that our approach outperforms well-established baselines on generalization to unseen environments using the large-scale Procgen benchmark. 
After revision:  In addition, we show that our approach outperforms well-established baselines on generalization to unseen environments using the large-scale Procgen benchmark. Our code is open-sourced and available at URL