Package: babyrobot
BabyRobotGymA Reinforcement Learning Gym Environment for Baby RobotThe code in this repository accompanies the Towards Data Science articleCreating a Custom Gym Environment for Jupyter Notebooks-Part 1: Creating the frameworkand shows the steps required to create a custom gym environment with graphical output in a Jupyter notebook.To install:pip install babyrobotAnimation ExampleAn example notebook showing how animation and movie creation can be done in the Baby Robot Gym environment:API ExampleThe example notebook, showing all of the API calls used to create a Baby Robot Gym environment can be opened here:Reinforcement LearningPart 1:State Values and Policy EvaluationTraining ExampleAn example of using the PPO Reinforcement Learning algorithm to train Baby Robot how to escape from a maze:Getting the Github Code:TestingThe test notebook, showing how to run a simple RL environment can be opened here:Cloning the Github repositoryTo get up and running with this simple custom Gym Environment, do the following:1.Get the code and move to the newly created directory:git clone https://github.com/WhatIThinkAbout/BabyRobotGym.gitcd BabyRobotGymthis directory contains the files and folder structure.2.Create a Conda environment and install the required packages:To be able to run our environment we need to have a few other packages installed, most notably 'Gym' itself. To make it easy to setup the environment the Github repo contains a couple of '.yml' files that list the required packages.To use these to create a Conda environment and install the packages, do the following (choose the one appropriate for your operating system):On Unix:conda env create -f environment_unix.ymlOn Windows:conda env create -f environment_windows.yml3.Activate the environment:We've created the environment with all our required packages, so now it's just a case of activating it, as follows:conda activate BabyRobotGym(when you're finished playing with this environment run "conda deactivate" to get back out)And once the environment has been activated, to create a Jupyter kernel, run the following. This will let the environment be selected from within your Jupyter notebook:python -m ipykernel install --user --name=BabyRobotGym4.Run the notebookEverything should now be in place to run our custom Gym environment. To test this we can run the sample Jupyter Notebook'baby_robot_gym_test.ipynb'that's included in the repository. This will load the'BabyRobotEnv-v1'environment and test it using the Stable Baseline's environment checker.To start this in a browser, just type:jupyter notebook baby_robot_gym_test.ipynb(When running in jupyter notebook the current Conda environment will automatically be used and the required packages should all be available. It's also possible to run "python -m ipykernel install --user --name=BabyRobotGym" which will create a Jupyter Notebook kernel, that can then be selected from the notebook's menu.)Or else just open this file in VS Code and make sure'BabyRobotGym'is selected as the kernel. This should make the'BabyRobotEnv-v1'environment, test it in Stable Baselines and then run the environment until it completes, which happens to occur in a single step, since we haven't yet written the 'step' function!Notes:If, while running in a terminal (as opposed to a Jupyter Notebook) you get the warning "DeprecationWarning: Jupyter is migrating its paths to use standard platformdirs", in a terminal run:export JUPYTER_PLATFORM_DIRS=1followed by:jupyter --paths