Expert-augmented actor-critic for ViZDoom and Montezumas Revenge
learning to act by predicting the future .