ViZDoom 3: How to wire up a convolutional network into ViZDoom?
Channel: RL Hugh
Date: 2022-07-15

How to connect a convolutional neural network to Doom game, so that it can see what is happening, and control the game?

This is part of a series where we use ViZDoom to control the Doom FPS game from Python. We use the PyTorch Deep Learning Framework to create a neural network that will see what is happening in the game, and decide what to do.

The previous parts are in the playlist at https://www.youtube.com/playlist?list=PLdBvOJzNTtDUO4UC7R6N6_H-TFa78dka1. Next video is at https://youtu.be/ofHehn0_M8I

ViZDoom is a reinforcement learning game environment, http://vizdoom.cs.put.edu.pl/ .

The code at the end of this part is at https://github.com/hughperkins/youtube-rl-demos/blob/vizdoom3/vizdoom_part3.py , under an MIT license. The code at the start is at https://github.com/hughperkins/youtube-rl-demos/blob/vizdoom2/vizdoom_part2.py 

Contents:
00:00 - Intro
00:26 - Revision
03:19 - Try forward pass
03:38 - Interlude: show low resolution image ok
04:20 - Back to forward pass
06:19 - Fix dimensions [N][C][H][W]
10:07 - argmax action prediction
11:40 - Feed model action to ViZDoom
14:20 - Action probability distribution
15:56 - Conclusion