ViZDoom 18: Watch training whilst computer learns to play Defend the Center! (This is run 2).
Channel: RL Hugh
Date: 27/07/2022

We're teaching a neural network to play Doom Defend the Center Scenario. We've added entropy regularization. Now let's run training, and see what happens!

This is part of a series where we get the computer to learn to play Doom FPS, using reinforcement learning, https://www.youtube.com/playlist?list=PLdBvOJzNTtDUO4UC7R6N6_H-TFa78dka1 . We are using ViZDoom to control the Doom game from Python. We are using the PyTorch deep  learning framework to build a neural network that will learn. The neural network contains a convolutional neural network, which will see what we see, and then can control the game.

The code for this video is available under MIT license at https://github.com/hughperkins/youtube-rl-demos/blob/vizdoom18/vizdoom/vizdoom_011.py

Contents:
00:00 - Intro
00:35 - Start Defend the Center training run 2!
02:43 - Pondering subtracting baseline from reward
03:45 - Save model more often
04:56 - Saturday 11pm
06:50 - Try running an episode, and THIS happened!
08:35 - Sunday 7am
10:58 - Sunday 7am, running current model
11:41 - Propose change episode timeout
12:38 - Propose modify reward normalization
13:31 - Outro