Omkar2118/datasets huggingface dataset:
DexHand

Inspired by OpenAI dexterous in-hand manipulation, we collected a synthetic RGB-D dataset of a Shadow Hand robot manipulating a cube towards arbitrary goal configurations. This dataset consists of about 10000 videos, each video including 25 RGB-D frames.
DexHand is challenging as the robot has 24 degrees of freedom, and there can be a significant amount of motion and occlusion between consecutive frames.

Introducing paper: T3VIP: Transformation-based 3D Video Prediction