Hugging Face Space: pico-lm/blimp
Author: pico-lm
SDK: static
title: BLiMP
tags: evaluate
metric
description: BLiMP is a challenge set for evaluating what language models (LMs) know about major grammatical phenomena in English. BLiMP consists of 67 sub-datasets, each containing 1000 minimal pairs isolating specific contrasts in syntax, morphology, or semantics. The data is automatically generated according to expert-crafted grammars.
For more information on BLiMP, see the [dataset card](https://huggingface.co/datasets/nyu-mll/blimp).