OpenDevin: An Open Platform for AI Software Developers as Generalist
  Agents
Authors: name: Xingyao Wang; name: Boxuan Li; name: Yufan Song; name: Frank F. Xu; name: Xiangru Tang; name: Mingchen Zhuge; name: Jiayi Pan; name: Yueqi Song; name: Bowen Li; name: Jaskirat Singh; name: Hoang H. Tran; name: Fuqiang Li; name: Ren Ma; name: Mingzhang Zheng; name: Bill Qian; name: Yanjun Shao; name: Niklas Muennighoff; name: Yizhe Zhang; name: Binyuan Hui; name: Junyang Lin; name: Robert Brennan; name: Hao Peng; name: Heng Ji; name: Graham Neubig
Published: 2024-07-23 17:50:43

Abstract: Software is one of the most powerful tools that we humans have at our
disposal; it allows a skilled programmer to interact with the world in complex
and profound ways. At the same time, thanks to improvements in large language
models (LLMs), there has also been a rapid development in AI agents that
interact with and affect change in their surrounding environments. In this
paper, we introduce OpenDevin, a platform for the development of powerful and
flexible AI agents that interact with the world in similar ways to those of a
human developer: by writing code, interacting with a command line, and browsing
the web. We describe how the platform allows for the implementation of new
agents, safe interaction with sandboxed environments for code execution,
coordination between multiple agents, and incorporation of evaluation
benchmarks. Based on our currently incorporated benchmarks, we perform an
evaluation of agents over 15 challenging tasks, including software engineering
(e.g., SWE-Bench) and web browsing (e.g., WebArena), among others. Released
under the permissive MIT license, OpenDevin is a community project spanning
academia and industry with more than 1.3K contributions from over 160
contributors and will improve going forward.