README.md

---
title: README
emoji: 💻
colorFrom: red
colorTo: gray
sdk: static
pinned: false
license: apache-2.0
---



---

OpenDILab is the **first decision intelligence platform** covering **the most comprehensive algorithms and applications both in academia and industry.** Since July 2021, OpenDILab has been officially open-sourced at the **World Artificial Intelligence Conference(WAIC)** opening ceremony. 

As an important part of OpenXLab from Shanghai AI Laboratory, OpenDILab features a complete set of training and deployment frameworks for decision intelligence, consisting of the **application ecological layer, algorithm abstraction layer, distributed management layer, and distributed execution layer.** OpenDILab also supports full-scale scheduling system optimization from a single machine to the joint training of thousands of CPU/GPU.

![feature](./opendilab1.0_feature.png)

OpenDILab contributes to the integration of the latest and most comprehensive achievements in academia as well as the standardization of complex problems in the industry. Our future vision is to promote the development of AI **from perceptual intelligence to decision intelligence,** taking AI technology to a higher level of the general intelligence era.

If you want to contact us & join us, you can  ✉️  to our team : <opendilab@pjlab.org.cn>.



# Overview of Model Zoo
<sup>(1): "🔓" means that this algorithm doesn't support this environment.</sup>
<sup>(2): "⏳" means that the corresponding model is in the upload waitinglist (Work In Progress).</sup>
### Deep Reinforcement Learning
<details open>
<summary>(Click to Collapse)</summary>

| Algo.\Env.   | [LunarLander](https://di-engine-docs.readthedocs.io/en/latest/13_envs/lunarlander.html) | [LunarLanderContinuous](https://di-engine-docs.readthedocs.io/en/latest/13_envs/lunarlander.html) | [BipedalWalker](https://di-engine-docs.readthedocs.io/en/latest/13_envs/bipedalwalker.html) | [Pendulum](https://di-engine-docs.readthedocs.io/en/latest/13_envs/pendulum.html) | [Pong](https://di-engine-docs.readthedocs.io/en/latest/13_envs/atari.html) | [SpaceInvaders](https://di-engine-docs.readthedocs.io/en/latest/13_envs/atari.html) | [Qbert](https://di-engine-docs.readthedocs.io/en/latest/13_envs/atari.html) | [Hopper](https://di-engine-docs.readthedocs.io/en/latest/13_envs/mujoco.html) | [Halfcheetah](https://di-engine-docs.readthedocs.io/en/latest/13_envs/mujoco.html) | [Walker2d](https://di-engine-docs.readthedocs.io/en/latest/13_envs/mujoco.html) |
| :-------------: | :-------------: | :-------------: | :------------------------: | :------------: | :--------------: | :------------: | :------------------: | :---------: | :---------: | :---------: |
| [PPO](https://arxiv.org/pdf/1707.06347.pdf) | [✅](https://huggingface.co/OpenDILabCommunity/Lunarlander-v2-PPO) | [✅](https://huggingface.co/OpenDILabCommunity/LunarLanderContinuous-v2-PPO) | [✅](https://huggingface.co/OpenDILabCommunity/BipedalWalker-v3-PPO) | [✅](https://huggingface.co/OpenDILabCommunity/Pendulum-v1-PPO) | [✅](https://huggingface.co/OpenDILabCommunity/PongNoFrameskip-v4-PPO) | [✅](https://huggingface.co/OpenDILabCommunity/SpaceInvadersNoFrameskip-v4-PPO) | [✅](https://huggingface.co/OpenDILabCommunity/QbertNoFrameskip-v4-PPO) | [✅](https://huggingface.co/OpenDILabCommunity/Hopper-v3-PPO) | [✅](https://huggingface.co/OpenDILabCommunity/HalfCheetah-v3-PPO) | [✅](https://huggingface.co/OpenDILabCommunity/Walker2d-v3-PPO) |
| [DQN](https://storage.googleapis.com/deepmind-media/dqn/DQNNaturePaper.pdf) | [✅](https://huggingface.co/OpenDILabCommunity/Lunarlander-v2-DQN) | 🔓 | 🔓 | 🔓 | [✅](https://huggingface.co/OpenDILabCommunity/PongNoFrameskip-v4-DQN) | [✅](https://huggingface.co/OpenDILabCommunity/SpaceInvadersNoFrameskip-v4-DQN) | [✅](https://huggingface.co/OpenDILabCommunity/QbertNoFrameskip-v4-DQN) | 🔓 | 🔓 | 🔓 |
| [C51](https://arxiv.org/pdf/1707.06887.pdf) | [✅](https://huggingface.co/OpenDILabCommunity/Lunarlander-v2-C51) | 🔓 | 🔓 | 🔓 | [✅](https://huggingface.co/OpenDILabCommunity/PongNoFrameskip-v4-C51) | [✅](https://huggingface.co/OpenDILabCommunity/SpaceInvadersNoFrameskip-v4-C51) | [✅](https://huggingface.co/OpenDILabCommunity/QbertNoFrameskip-v4-C51) | 🔓 | 🔓 | 🔓 |
| [DDPG](https://arxiv.org/pdf/1509.02971.pdf) | 🔓 | [✅](https://huggingface.co/OpenDILabCommunity/LunarLander-v2-DDPG) | [✅](https://huggingface.co/OpenDILabCommunity/BipedalWalker-v3-DDPG) | [✅](https://huggingface.co/OpenDILabCommunity/Pendulum-v1-DDPG) | 🔓 | 🔓 | 🔓 | [✅](https://huggingface.co/OpenDILabCommunity/Hopper-v3-DDPG) | [✅](https://huggingface.co/OpenDILabCommunity/HalfCheetah-v3-DDPG) | [✅](https://huggingface.co/OpenDILabCommunity/Walker2d-v3-DDPG) |
| [TD3](https://arxiv.org/pdf/1802.09477.pdf) | 🔓 | [✅](https://huggingface.co/OpenDILabCommunity/LunarLander-v2-TD3) | [✅](https://huggingface.co/OpenDILabCommunity/BipedalWalker-v3-TD3) | [✅](https://huggingface.co/OpenDILabCommunity/Pendulum-v1-TD3) | 🔓 | 🔓 | 🔓 |[✅](https://huggingface.co/OpenDILabCommunity/Hopper-v3-TD3)  | [✅](https://huggingface.co/OpenDILabCommunity/HalfCheetah-v3-TD3) | [✅](https://huggingface.co/OpenDILabCommunity/Walker2d-v3-TD3) |
| [SAC](https://arxiv.org/pdf/1801.01290.pdf) | 🔓 | [✅](https://huggingface.co/OpenDILabCommunity/LunarLander-v2-SAC) | [✅](https://huggingface.co/OpenDILabCommunity/BipedalWalker-v3-SAC) | [✅](https://huggingface.co/OpenDILabCommunity/Pendulum-v1-SAC) | 🔓 | 🔓 | 🔓 | [✅](https://huggingface.co/OpenDILabCommunity/Hopper-v3-SAC) | [✅](https://huggingface.co/OpenDILabCommunity/HalfCheetah-v3-SAC) | [✅](https://huggingface.co/OpenDILabCommunity/Walker2d-v3-SAC) |
| [IMPALA](https://arxiv.org/pdf/1802.01561.pdf) | [✅](https://huggingface.co/OpenDILabCommunity/Lunarlander-v2-IMPALA) |  |  |  | [✅](https://huggingface.co/OpenDILabCommunity/PongNoFrameskip-v4-IMPALA)  | [✅](https://huggingface.co/OpenDILabCommunity/SpaceInvadersNoFrameskip-v4-IMPALA)  |  |  |  |  |

</details>

### Monte Carlo tree search
<details open>
<summary>(Click to Collapse)</summary>

| Algo.\Env.   | [CartPole](https://di-engine-docs.readthedocs.io/en/latest/13_envs/cartpole.html) | [LunarLander](https://di-engine-docs.readthedocs.io/en/latest/13_envs/lunarlander.html) | [LunarLanderContinuous](https://di-engine-docs.readthedocs.io/en/latest/13_envs/lunarlander.html) | [Pendulum](https://di-engine-docs.readthedocs.io/en/latest/13_envs/pendulum.html) | [Pong](https://di-engine-docs.readthedocs.io/en/latest/13_envs/atari.html) | [Breakout](https://di-engine-docs.readthedocs.io/en/latest/13_envs/atari.html) | [MsPacman](https://di-engine-docs.readthedocs.io/en/latest/13_envs/atari.html) | [TicTacToe]() | []() | []() |
| :-------------: | :-------------: | :-------------: | :------------------------: | :------------: | :--------------: | :------------: | :------------------: | :---------: | :---------: | :---------: |
| [AlphaZero](https://www.science.org/doi/10.1126/science.aar6404) |  |  |  |  |  |  |  | [✅](https://huggingface.co/OpenDILabCommunity/TicTacToe-play-with-bot-AlphaZero) |  |  |
| [Sampled AlphaZero](https://www.science.org/doi/10.1126/science.aar6404) |  |  |  |  |  |  |  |  |  |  |
| [Muzero](https://arxiv.org/abs/1911.08265) | [✅](https://huggingface.co/OpenDILabCommunity/CartPole-v0-MuZero) | [✅](https://huggingface.co/OpenDILabCommunity/LunarLander-v2-MuZero) |  |  | [✅](https://huggingface.co/OpenDILabCommunity/PongNoFrameskip-v4-MuZero) |  | [✅](https://huggingface.co/OpenDILabCommunity/MsPacmanNoFrameskip-v4-MuZero) | [✅](https://huggingface.co/OpenDILabCommunity/TicTacToe-play-with-bot-MuZero) |  |  |
| [EfficientZero](https://arxiv.org/abs/2111.00210) | [✅](https://huggingface.co/OpenDILabCommunity/CartPole-v0-EfficientZero) |  |  |  |  |  |  |  |  |  |
| [Gumbel MuZero](https://openreview.net/pdf?id=bERaNdoegnO&) | [✅](https://huggingface.co/OpenDILabCommunity/CartPole-v0-GumbelMuZero) |  |  |  |  |  |  |  |  |  |
| [Sampled EfficientZero](https://arxiv.org/abs/2104.06303) | [✅](https://huggingface.co/OpenDILabCommunity/CartPole-v0-SampledEfficientZero) |  |  |  |  |  |  |  |  |  |
| [Stochastic MuZero](https://openreview.net/pdf?id=X6D9bAHhBQ1) |  |  |  |  |  |  |  |  |  |  |

</details>

### Multi-Agent Reinforcement Learning
<details close>
<summary>(Click for Details)</summary>
TBD
</details>

### Offline Reinforcement Learning
<details close>
<summary>(Click for Details)</summary>
TBD
</details>

### Model-Based Reinforcement Learning
<details close>
<summary>(Click for Details)</summary>
TBD
</details>