Package: robosuite
robosuite[Homepage][White Paper][Documentations][ARISE Initiative]Latest Updates[11/15/2022]v1.4: Backend migration to DeepMind's officialMuJoCo Python binding, robot textures, and bug fixes :robot:[release notes][documentation][10/19/2021]v1.3: Ray tracing and physically based rendering tools :sparkles: and access to additional vision modalities 🎥[video spotlight][release notes][documentation][02/17/2021]v1.2: Added observable sensor models :eyes: and dynamics randomization :game_die:[release notes][12/17/2020]v1.1: Refactored infrastructure and standardized model classes for much easier environment prototyping :wrench:[release notes]robosuiteis a simulation framework powered by theMuJoCophysics engine for robot learning. It also offers a suite of benchmark environments for reproducible research. The current release (v1.4) features long-term support with the official MuJoCo binding from DeepMind. This project is part of the broaderAdvancing Robot Intelligence through Simulated Environments (ARISE) Initiative, with the aim of lowering the barriers of entry for cutting-edge research at the intersection of AI and Robotics.Data-driven algorithms, such as reinforcement learning and imitation learning, provide a powerful and generic tool in robotics. These learning paradigms, fueled by new advances in deep learning, have achieved some exciting successes in a variety of robot control problems. However, the challenges of reproducibility and the limited accessibility of robot hardware (especially during a pandemic) have impaired research progress. The overarching goal ofrobosuiteis to provide researchers with:a standardized set of benchmarking tasks for rigorous evaluation and algorithm development;a modular design that offers great flexibility to design new robot simulation environments;a high-quality implementation of robot controllers and off-the-shelf learning algorithms to lower the barriers to entry.This framework was originally developed since late 2017 by researchers inStanford Vision and Learning Lab(SVL) as an internal tool for robot learning research. Now it is actively maintained and used for robotics research projects in SVL and theUT Robot Perception and Learning Lab(RPL). We welcome community contributions to this project. For details please check out ourcontributing guidelines.This release ofrobosuitecontains seven robot models, eight gripper models, six controller modes, and nine standardized tasks. It also offers a modular design of APIs for building new environments with procedural generation. We highlight these primary features below:standardized tasks: a set of standardized manipulation tasks of large diversity and varying complexity and RL benchmarking results for reproducible research;procedural generation: modular APIs for programmatically creating new environments and new tasks as combinations of robot models, arenas, and parameterized 3D objects;robot controllers: a selection of controller types to command the robots, such as joint-space velocity control, inverse kinematics control, operational space control, and 3D motion devices for teleoperation;multi-modal sensors: heterogeneous types of sensory signals, including low-level physical states, RGB cameras, depth maps, and proprioception;human demonstrations: utilities for collecting human demonstrations, replaying demonstration datasets, and leveraging demonstration data for learning. Check out our sister projectrobomimic;photorealistic rendering: integration with advanced graphics tools that provide real-time photorealistic renderings of simulated scenes.CitationPlease citerobosuiteif you use this framework in your publications:@inproceedings{robosuite2020,title={robosuite: A Modular Simulation Framework and Benchmark for Robot Learning},author={Yuke Zhu and Josiah Wong and Ajay Mandlekar and Roberto Mart\'{i}n-Mart\'{i}n and Abhishek Joshi and Soroush Nasiriany and Yifeng Zhu},booktitle={arXiv preprint arXiv:2009.12293},year={2020}}