InfantAgent-Next: A Multimodal Generalist Agent for Automated Computer
  Interaction
Authors: name: Bin Lei; name: Weitai Kang; name: Zijian Zhang; name: Winson Chen; name: Xi Xie; name: Shan Zuo; name: Mimi Xie; name: Ali Payani; name: Mingyi Hong; name: Yan Yan; name: Caiwen Ding
Published: 2025-05-16 05:43:27

Abstract: This paper introduces InfantAgent-Next, a generalist agent capable
of interacting with computers in a multimodal manner, encompassing text,
images, audio, and video. Unlike existing approaches that either build
intricate workflows around a single large model or only provide workflow
modularity, our agent integrates tool-based and pure vision agents within a
highly modular architecture, enabling different models to collaboratively solve
decoupled tasks in a step-by-step manner. Our generality is demonstrated by our
ability to evaluate not only pure vision-based real-world benchmarks (i.e.,
OSWorld), but also more general or tool-intensive benchmarks (e.g., GAIA and
SWE-Bench). Specifically, we achieve 7.27% accuracy on OSWorld,
higher than Claude-Computer-Use. Codes and evaluation scripts are open-sourced
at https://github.com/bin123apple/InfantAgent.