Tracking object poses in the context of robust body pose estimates ?
We track 3D object pose (translation+rotation) during human-object interactions. To do so we learn 3D spatial relationships between objects and different body parts. These mappings enable our tracker to automatically initialise and re-initialise. It can also select the best parts from which to make predictions about object-pose. Results are better than when predicting only from hands (common in the literature).
human-object interaction object localisation object tracking depth data rgb-d