Before revision:  In supervised settings, representations discovered through unsupervised pre-training offer important benefits when transferred to downstream tasks . Given the nature of the reinforcement learning problem, we argue that representation alone is not enough for efficient transfer in challenging domains and explore how to transfer knowledge through behavior.
After revision:  In supervised settings, representations discovered through unsupervised pre-training offer important benefits when transferred to downstream tasks . Given the nature of the reinforcement learning problem, we argue that standard fine-tuning strategies alone are not enough for efficient transfer in challenging domains and explore how to transfer knowledge through behavior.