Omkar2118/datasets huggingface dataset:
Robotic Pushing

The **Robotic Pushing Dataset**  is a dataset for video prediction for real-world interactive agents which consists of 59,000 robot interactions involving pushing motions, including a test set with novel objects. In this dataset, accurate prediction of videos conditioned on the robot's future actions amounts to learning a "visual imagination" of different futures based on different courses of action.

Introducing paper: Unsupervised Learning for Physical Interaction through Video Prediction