Omkar2118/datasets huggingface dataset:
Physion

**Physion** is a visual and physical prediction benchmark to measure the performance of machine learning models on making predictions about commonplace real world physical events. In realistically simulating a wide variety of physical phenomena -- rigid and soft-body collisions, stable multi-object configurations, rolling and sliding, projectile motion -- this dataset presents a more comprehensive challenge than existing benchmarks. Moreover, the dataset also contains human responses for the stimuli so that model predictions can be directly compared to human judgments.

Introducing paper: Physion: Evaluating Physical Prediction from Vision in Humans and Machines
Counting Probe
Full name: Counting Probe based on Visual7W

Probing cross-modal capabilities of Vision & Language models with a counting task.

* binary classification
* following a FOIL setup (as introduced by Shekhar et al. 2017: https://www.aclweb.org/anthology/P17-1024/)

Introducing paper: Seeing past words: Testing the cross-modal capabilities of pretrained V&L models on counting tasks