Embody 3D: A Large-scale Multimodal Motion and Behavior Dataset
Authors: name: Claire McLean, name: Makenzie Meendering, name: Tristan Swartz, name: Orri Gabbay, name: Alexandra Olsen, name: Rachel Jacobs, name: Nicholas Rosen, name: Philippe de Bree, name: Tony Garcia, name: Gadsden Merrill, name: Jake Sandakly, name: Julia Buffalini, name: Neham Jain, name: Steven Krenn, name: Moneish Kumar, name: Dejan Markovic, name: Evonne Ng, name: Fabian Prada, name: Andrew Saba, name: Siwei Zhang, name: Vasu Agrawal, name: Tim Godisart, name: Alexander Richard, name: Michael Zollhoefer
Organization: Meta Research

The Codec Avatars Lab at Meta introduces Embody 3D, a multimodal dataset of
500 individual hours of 3D motion data from 439 participants collected in a
multi-camera collection stage, amounting to over 54 million frames of tracked
3D motion. The dataset features a wide range of single-person motion data,
including prompted motions, hand gestures, and locomotion; as well as
multi-person behavioral and conversational data like discussions, conversations
in different emotional states, collaborative activities, and co-living
scenarios in an apartment-like space. We provide tracked human motion including
hand tracking and body shape, text annotations, and a separate audio track for
each participant.