3 Reinforcement Learning Environments Every ML Enthusiast Should Know
Tags: azure, machinelearning, cloud
Published: 2019-11-20 13:59:06

---
title: 3 Reinforcement Learning Environments Every ML Enthusiast Should Know
published: true
date: 2019-11-20 13:47:15 UTC
tags: azure,machinelearning, cloud
canonical_url: https://medium.com/microsoftazure/3-microsoft-reinforcement-learning-environments-every-ml-researcher-should-know-7cdc4c6e2fa1
---

![](https://cdn-images-1.medium.com/max/533/1*nTPbBkB3rOFCMSQN8u31mw.gif)

Reinforcement learning is the study of decision making over time with consequences. The field has developed systems to make decisions in complex environments based on external, and possibly delayed, feedback.

[Reinforcement Learning - Personalizer - Azure Cognitive Services](https://docs.microsoft.com/en-us/azure/cognitive-services/personalizer/concepts-reinforcement-learning/?WT.mc_id=blog-medium-abornst)

> “Microsoft Research, works on developing the theory, algorithms and systems for technology that learns from its own successes (and failures), explores the world “just enough” to learn, and can infer which decisions have led to those outcomes. Our primary goal is reinforcement learning in the real world: understanding how to build systems that work, even when simulation is unavailable and samples are scarce.” — [Microsoft R&D Reinforcement Learning Team](https://www.microsoft.com/en-us/research/group/reinforcement-learning-group/?WT.mc_id=blog-medium-abornst)

To celebrate hosting the [Reinforcement Learning Israel](https://www.meetup.com/Reinforcement-Learning-Israel-Meetups/)Meetup organized by the talented [Shani Gamrian](https://il.linkedin.com/in/shani-gamrian) at the [Microsoft Reactor](https://developer.microsoft.com/en-us/reactor/Location/Tel%20Aviv?WT.mc_id=blog-medium-abornst) here is a list of three Reinforcement Learning Environments every ML enthusiast should know.

You can get a free subscription for Azure to get started playing with each of these environments below

[Create your Azure free account today | Microsoft Azure](https://azure.microsoft.com/en-us/free/?WT.mc_id=7tips-medium-abornst&source=post_page-----6bbdebf49a6f----------------------)

If you have any questions feel free to tweet to [@pythiccoder](https://twitter.com/pythiccoder).

### 1) Text World

![](https://cdn-images-1.medium.com/max/480/0*JwLeU7qWOVjeri0m.jpg)

[TextWorld](https://www.microsoft.com/en-us/research/project/textworld/?WT.mc_id=blog-medium-abornst) is an open-source, extensible engine that both generates and simulates text games.

{% youtube WVIIigrPUJs %}

You can use it to train reinforcement learning (RL) agents to learn skills such as language understanding and grounding, combined with sequential decision making.

[microsoft/TextWorld](https://github.com/microsoft/textworld)

You can check out the code for getting started with Text World with the link above.

### 2) AirSim

AirSim as a platform for AI research to experiment with deep learning, computer vision and reinforcement learning algorithms for autonomous vehicles.

{% youtube -WfTr1-OBGQ %}

AirSim is a simulator for drones, cars and more, built on [Unreal Engine](https://www.unrealengine.com/) (we now also have an experimental [Unity](https://unity3d.com/) release). It is open-source, cross platform, and supports hardware-in-loop with popular flight controllers such as PX4 for physically and visually realistic simulations. It is developed as an Unreal plugin that can simply be dropped into any Unreal environment. Similarly, we have an experimental release for a Unity plugin.

Code can be found here:

[microsoft/AirSim](https://github.com/microsoft/AirSim)

### 3) Project Malamo

The Malmo platform is a AI experimentation platform built on top of Minecraft, and designed to support research in artificial intelligence.

![](https://cdn-images-1.medium.com/max/800/0*5C-D1UyxeyTqG2gR.png)

> Project Malmo sets out to address these core research challenges, addressing them by integrating (deep) reinforcement learning, cognitive science, and many ideas from artificial intelligence.

[Project Malmo - Microsoft Research](https://www.microsoft.com/en-us/research/project/project-malmo/?WT.mc_id=blog-medium-abornst)

Minecraft is ideal for artificial intelligence research for the same reason it is addictively appealing to the millions of fans who enter its virtual world every day. Unlike other computer games, Minecraft offers its users endless possibilities, ranging from simple tasks, like walking around looking for treasure, to complex ones, like building a structure with a group of teammates. Code for Project Maleo can be found with the link below:

[microsoft/malmo](https://github.com/Microsoft/malmo#getting-started)

### Bonus Production RL @Microsoft

In my role as an [AI Cloud Advocate](https://developer.microsoft.com/en-us/advocates/ari-bornstein) I’m often asked for production examples of Reinforcement Learning, Azure provides a custom recommendation service if you are interested in a production example of reinforcement learning strongly suggest checking it out.

[Personalizer documentation - Azure Cognitive Services](https://docs.microsoft.com/en-us/azure/cognitive-services/personalizer/?WT.mc_id=blog-medium-abornst)

### Next Steps

If you haven’t yet join the group and check out the Global Microsoft Reactor Events page for similar events across the world

- [Reinforcement Learning Israel Meetup (Tel Aviv-Yafo, Israel)](https://www.meetup.com/Reinforcement-Learning-Israel-Meetups/)
- [Microsoft Reactor. Learn. Connect. Innovate.](https://developer.microsoft.com/en-us/reactor/?WT.mc_id=blog-medium-abornst)

### About the Author

[**Aaron (Ari) Bornstein**](https://www.linkedin.com/in/aaron-ari-bornstein-22aa7a77/) is an avid AI enthusiast with a passion for history, engaging with new technologies and computational medicine. As an Open Source Engineer at Microsoft’s Cloud Developer Advocacy team, he collaborates with Israeli Hi-Tech Community, to solve real world problems with game changing technologies that are then documented, open sourced, and shared with the rest of the world.

* * *